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w,ere generated according to a multidimensional two-parame*-er logistic 
model using four groups of examinees. The groups of examinees differed 
in the degree of inter-dimension ability correlation. 

To evaluate the. effects of correlated abilities on observed test 
characteristics, the simulated response data were analyzed using item 
analysis and factor analysis techniques. To assess the effects of 
correlated abilities on the use of the multidimensional model, the 
parameters of the model were estimated, and the estimates were compared 
to the true parameters . 

The results of this study indicated that the presence of correlated 
abilities has important implications for the characteristics of test data, 
and for the application of multidimensional item response theory models. 
• It was concluded that it is necessary to consider latent item structure 
as well as latent ability structure in test construction and analysis. 
It was also concluded that use of multidimensional item response theory 
models that do not explicitly account for correlated abilities may result 
in misinterpretation of the underlying dimensions. It was suggested 
that research should be conducted to determine the nature of the 
misinterpretation and to perhaps develop an item response theory analogue 
to factor rotation. 
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An Investigation of the Kffect of Correlated Abilities 
on Observed Test Characteristics 



Because of the required assumption of unidimensionality > much of the item 
response theory (IRT) methodology that has been developed is inappropriate for 
a wide range of applications. In such applications, either unidimensional 
sets of items cannot be constructed, or they are not desired. Until recently, 
in such circumstances the practitioner has been forced to abandon IRT and 
adopt more traditional test analysis procedures, or to inappropriately apply 

IRT methods and hope the procedures are robust to violations of the 
unidimensionality assumption. Unfortunately, such robustness has not been 
demonstrated* 

In recent years, researchers have begun grappling with the dimensionality 
problem. Several IRT models have been proposed for the multidimensional case, 
and recently some theory and procedures have been developed for applying such 
models (Reckase and McKinley, i982; McKinley and Reckase, 1983a, 1983b). The 
work that has been done in this area indicates that it has great promise for 
dealing with the dimensionality problem. 

In multidimensional item respoase theory (MIRT) , one of the most 
important questions that has not yet been addressed focuses on the effect of 
correlated abilities on the interpretation of model parameters. Logically, it 
•seems desirable to construct different, homogeneous (unidimensional) sets of 
items to measure each ability or trait of interest. In the case of unrelated 
abilities, such as math computation ability and vocabulary ability, this is a 
practical approach. However, if the abilities of interest are related, such 
as in the case of reading comprehension and vocabulary, constructing an item 
set that measures only one of these two abilities is more difficult. 
Developing a unidimensional set of vocabulary items seems easy, but how does 
one construct reading comprehension items that do not also include at least a 
small vocabulary component? 

The purpose of this study is to investigate the effects of varying 
degrees of correlation between abilities on observed test characteristics • 
This research has two primary objectives. The first objective is to identify 
the characteristics of response data yielded in the case of correlated 
abilities. If unique characteristics can be identified and used to 
distinguish the multidimensional data from those produced in the 
unidimensional case, then it should be possible to identify real test 
situations in which a MIRT, model is appropriate. The second objective of this 
research is to determine the effect of varying degrees of correlation between 
abilities on estimates of parameters from a MIRT model which does not 
explicitly account for such a correlation. 

Method 

MIRT methodology is relatively new and probably unfamiliar to many. 
Therefore, before continuing with a discussion of this research, a brief 
discussion of the MIRT Model selected for this study will be presented. For a 
more detailed discussion of this model, see McKinley and Reckase, 1983a. 
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The MIRT Model / 

The MIRT model selected for this study is an extension of the two- 
parameter logistic (2PL) model proposed by Birnbdum (1968). The 
multidimensional 2PL model, or M2PL model, is given by 

exp(d + a. ' 

where 9^^ is a vector of ability parameters for examinee j , a^^ is a vector of 
discrimination parameters for item i, d^^ is a scalar item parameter related to 
item difficulty, and is the probability of a correct response to item i 

by an examinee having ability 6^ . 

The discrimination and ability vectors in Equation 1 are both of order m, 

where m is the number of dimensions comprising the complete latent space. 

The a/ 8. term In Equation 1 can be written as 
—i 

^' - J, • 

where a^^^^ is the item discrimination parameter for dimension k and 6^^ is the 

examinee ability parameter for dimension k. In the unidimensional case 
Equation 1 simplifies to the 2PL model (without che D=1.7 term usually used in 
the 2PL model) with 



- -a^b^ , (J) 

where is the difficulty parameter for item i from the 2PL model. 
Design 

The basic design of this study involved the simulation and analysis of 
response data generated for examinees having varying levels of correlation 
between their abilities on different dimensions. The generated data were then 
analyzed using traditional test analysis techniques to determine the effects 
of the correlated abilities on the test characteristics. Afterward, the data 
were analyzed using the M2PL model to determine the effects of correlated 
abilities on the estimates of the parameters of the model. 
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Datasets 

Simulated test data were generated for two different types of test. The 
first test type measured two dimensions, with half of the items on the test 
measuring predominantly one dimension, and other half measuring predominantly 
the second dimension. The second test type also measured two dimensions, but 
for this test each item measured both dimensions. Four datasets were 
generated for each test using interdimenslonal ability correlations of .7, .5, 
,35, and 0. Table 1 summarizes the eight datasets that were created. 

Table 1 



Simulated Datasets 



Dataset 


Test 




1 


1 


0.70 


2 


1 


0.50 


3 


1 


0.35 


4 


1 


o.no 


5 


2 


0.70 


6 


2 


0.50 


7 


2 


0.35 


8 


2 


0.00 



Table 2 shows the true item parameters used to simulate the two tests. 
Each test had 50 items, and the same set of d-parameters was used for both 
tests. As can be seen, for test 1 the items generally have high 
discriminations on one dimension or the other, but not both. For test 2 th 
Items tend to have high discriminations on both dimensions. 



Table 2 

True Item Parameters Used 
To Simulate Both Tests 



Test 1 Test 2 



Item 


d 


^1 


^2 


^1 


^2 


1 


-1 .34 


1 .34 


0.46 


1.17 


0.80 


2 


2.25 


1 . 3*) 


0.40 


0.66 


1.25 


3 


-0.04 


1.36 


0.38 


0.85 


1.13 


4 


1 .95 


1 .36 


0.38 


1.03 


0.97 


5 


-0.78 


1 .39 


0.27 


0.74 


1.21 


6 


-1.37 


1 .37 


0.34 


0.75 


1.20 


7 


0.51 


1 .35 


0.41 


0.82 


1.15 


8 


-0.35 


1 .37 


0.34 


0.61 


1.27 


9 


-0.47 


1.39 


0.27 


0.76 


1.19 


10 


-1 .70 


1 .37 


0.37 


0.91 
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Table 2 (Continued) 



True Item Parameters Used 
To Simulate Both Tests 



Test 1 Test 2 

Item d 

ai ai &2 



11 


-0.51 


1.38 


12 


0,27 


1.39 


13 


-0.14 


1.21 


14 


-1.71 


1.30 


15 


0.41 


1.39 


16 


1.15 


1.37 


17 


-0.52 


1.37 


18 


0.40 


1.39 


19 


-0.28 


1.41 


20 


0.59 


1.34 


?1 


-2.77 


1.35 


22 


-0.17 


1.36 


21 


-0.58 


• 1.35 


24 


-0.11 


1.39 


2S 


-0.61 


1.38 


2fi 


1 . 20 


0.33 


27 


0.14 


0.35 


28 


1 .40 


0.07 




0.34 


0.21 


in 


-1 .02 


0.32 


«J 1 


1 .05 


0.34 


12 


0.31 


0.55 


11 


-0.83 


0.45 


14 


0.55 


0.33 


15 


1.46 


0.42 


36 


1 .05 


0.33 


37 


-1.05 


0.37 


38 


0.34 


0.54 


39 


0.20 


0.37 


40 


-0.45 


'0.60 


41 


1.67 


0.34 


42 


-0.20 


0.27 


43 


-0.69 


0.30 


44 


0.35 


0.28 


45 


0.93 


0.47 


46 


0.86 


0.67 


47 


-1.70 


0.41 


48 


-1.54 


0.40 


49 


-0.57 


0.33 


50 


-C.78 


0.28 


Mean 


-0.06 


0.86 


S.D. 


1.04 


0.51 



0.30 0.98 1.02 

0.27 0,93 1.07 

0.73 1.20 .. 0.75 

0.55 0.68 1.24 

0.27 0.68 1.24 

0.37 1.02 0.98 

0.35 1.02 0.98 

0.28 0.83 1.15 

0.11 1.25 0.67 

0.46 1.06 0.94 

0.41 0.61 1.27 

0.38 0.90 1.09 

0.44 0.74 1.21 

0.26 0.72 1.22 

0.30 0.94 1.06 

1.38 0.57 1.30 

1.37 0.73 1.21 
1.41 0.99 1.01 
1.40 0.75 i.20 

1.38 0.86 1.12 
1.37 0.83 1.14 

1.30 0.74 1.21 

1.34 0.61 1.27 

1.37 0.99 1.01 

1.35 0.79 1.17 

1.38 1.07 0.92 
1.37 1.11 0.88 

1.31 0.80 1.17 

1.37 0.68 1.24 

1.36 1.17 0.79 

1.37 0.72 1.22 

1.39 0.93 1.07 

1.38 1.17 C.79 

1.39 0.93 1.07 

1.34 1.15 0.82 
1.25 1.10 0.89 

1.35 1.14 0.83 

1.36 1.04 0.95 

1.38 1.06 0.94 

1.39 0.95 UOl 

0.86 0,89 1.07 

0.51 0.18 0.16 



Each group of examinees consisted of 2000 simulated subjects with- true 
abilities selected at random from a bivariate normal distribution having both 
means equal to 0.0, both standard deviations equal to 0*50, and having the 
appropriate correlation. Each group waa used for only one of the two tests. 
Thus, there were eight sets of item responses generated. Each vSet of 
responses was stored in the appropriate dataset, depending on the test and the 
correlation between abilities. The same set of analyses were then run on each 
dataset . 

Analyses 

There were four types of analyses run on each dataset in Table 1. The 
first type was an item analysis. This consisted cf computing item proportion- 
correct difficulty indices, item point blserial discrimination indices , and a 
KR-20 test reliability coefficient. 

The second type of analysis performed on each dataset was a principal 
components analysis. More specifically, a principal components analysis of 
tetrachoric correlations was performed on each datjset. Using the results of 
the principal components analyses, both a varimax rotated and an oblique 
rotated factor solution were obtained for each dataset. In each case two 
factors were rotated. 

The third type of analysis performed was the application of the M2PL 
model to the data. This consisted of estimating item and person parameters 
for the M2PL model for each dataset. Parameter estimation for the M2PL model 
was performed using the MAXLOG program (McKinley and Reckase, 1983c). 

The final type of analysis performed on these data consisted of 
correlational analyses. Correlations were computed among true and estimated 
item parameters, item statistics (traditional difficulty and discrimination), 
and factor loadings. Correlations between true and estimated ability 
par^eters were also computed. 

Results 
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As was discussed above, there were four types of analyses performed on 
the eight datasets created for this study - item analyses, principal component 
analyses, MIRT analyses, and correlation analyses. The results obtained from 
all four of these sets of analyses will be presented for each dataset 
separately, beginning with the four datasets based on the first test. 
Remember that the first test contained two subsets of items, each of which was 
relatively unidimensional . After presenting these results, the results for 
the second test will be presented. The second test had items that each 
measured two dimensions. 

Test 1 Analyses 

Dataset I . Table 3 shows the results of the item analysis, principal 
components analysis, and MIRT analysis of the first dataset. This dataset was 
created using test 1 and a group of examinees having an inter^dimension 
ability correlation of 0.70. Thii columns headed 'Item Parameter Estimates' 
are the results obtained from the MIRT analysis, and are estimates of the item 
parameters of the M2PL model. The columns headed 'Item Statistics' are the 
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proportion-correct item difficulties (p) and item point biserial 
discrimination indexes (pbis) obtained from the item analysis of the first 
dataset. .Columns 6 and 7 are the varimax rotated factor loadings for the 
first two factors of the principal components analysis of tetrachoric 
correlations. The last two columns are oblique rotated factor loadings for 
the first two factors from the principal components analysis. 



Table 3 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 1 

Item Parameter Item Factor Loadings 



Item Estimates Statistics Orthogonal Oblique 





d 


^1 


^2 


P 


pbis 


I 


11 


1 


TT 


1 


-1 .32 


0.43 


0.88 


0.24 


0,27 


0.16 




n n 1 
u . U 1 


U . t / 


2 


2.26 


0.69 


0.73 


0.88 


0.24 


0.29 


0.3^ 


n 0 1 
U . Z 1 


U . Zo 


3 


-0.07 


0.72 


0.89 


0.49 


0.37 


0.33 




U . Z J 


n 1A 


4 


2.04 


0.80 


0.44 


0.86 


0.22 


0.36 




n 1A 


n OR 

U . U O 


5 


-0.89 


0.46 


0.91 


0.32 


0.30 


0.18 


0.45 


U . U J 


n A 7 
U . / 


6 


-1 .39 


0.64 


0.59 


0.23 


0.26 


0.34 


0 .23 


n 11 
U . J 1 


n 1 ^ 

U . 1 J 


7 


0.42 


0.72 


0.77 


0.59 


0.34 


0.32 


0 .38 


U . ZZ 


n n 


8 


-0.32 


0.51 


0.74 


0.43 


0.30 


0.22 


0.40 


n in 
U . lU 


n 10 


9 


-0.54 


0.38 


1 .02 


0.39 


0.31 


0. 16 


0.47 


n n 1 
— U . U 1 


n tin 

U . jU 


10 


-1.79 


0.43 


0.97 


0.18 


0.26 


0.16 


0.45 




U . '♦o 


1 1 


-0 . 56 


U . 1 


1.11 


U . jy 






0.48 


0.02 


0.50 


12 


0.26 


0.45 


0.68 


0.56 


0.28 


0.19 


0.38 


0.07 


0.38 


13 


-0.20 


0.59 


1.00 


0.46 


0.35 


0.27 


0.43 


0.15 


0.41 


14 


-1.79 


0.66 


0.78 


0.18 


0.27 


0.25 


0.3*) 


0.14 


0.36 


15 


0.31 


0.46 


0.73 


0.57 


0.29 


0.20 


0.49 


0.07 


0.39 


16 


1.10 


0.46 


0.91 


0.72 


0.29 


0.20 


0.43 


0.06 


0.43 


17 


-0.62 


0.45 


1.03 


0.38 


0.32 


0.18 


0.49 


0.01 


0.52 


18 


0.33 


0.45 


1.02 


0.57 


0.32 


0.21 


0.45 


0.06 


0.45 


19 


-0.38 


0.06 


1.33 


0.43 


0.26 


0.05 


0.50 


-0.16 


U.59 


20 


0.58 


0.60 


0.81 


0.62 


0.33 


0.25 


0.42 


0.12 


0.40 


21 


-2.82 


0.37 


0.73 


0.07 


0.15 


0.10 


0.37 


-0.03 


0.40 


22 


-0.17 


0.51 


0.89 


0.46 


0.33 


0.26 


0.40 


0.14 


0.37 


23 


-0.69 


0.51 


0,95 


0.36 


0.32 


0.22 


0.44 


0.07 


0.44 


24 


-0.09 


0.60 


0.67 


0.48 


0.31 


0.25 


0.38 


0.14 


0.35 


25 


-1.10 


0.0 


2.00 


0.35 


0.29 


0.07 


0.54 


-0.15 


0.62 


26 


1.26 


1.01 


0.48 


0.74 


0.31 


0.46 


0.19 


0.49 


0.02 


27 


0.17 


0.88 


0.46 


0.53 


0.32 


0.42 


0.20 


0.43 


0.06 


2f 


1.34 


0.78 


0.28 


0.77 


0.23 


0.42 


0.08 


0.49 


-0.10 


29 


0.36 


0.92 


0.34 


0.57 


0.30 


0.43 


0.16 


0.46 


0.00 


30 


-1 .10 


0.95 


0.40 


0.28 


0.29 


0.43 


0.19 


0.45 


0.04 


31 


0.19 


1 .62 


0.26 


0.69 


0.33 


0.55 


0.14 


0.62 


-0.08 


32 


0.23 


0.70 


0.44 


0.55 


0.29 


0.36 


0.22 


0.34 


O.ll 


33 


-0.89 


0.70 


0.50 


0.31 


0.28 


0.35 


0.25 


0.32 


0.15 


34 


0.57 


1.34 


0.29 


0.60 


0.33 


0.53 


0.13 


0.59 


-0.08 
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Table 3(Cont Inued) 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 1 

Item Parameter Item Factor Loadings 



Item Estimates Statistics Orthogonal Oblique 





d 


^1 


^2 


P 


pbis 


I 


II 


I 


II 


35 


1.73 


1.45 


0.21 


0.78 


0.29 


0.53 


0.12 


0.60 


-0.09 


36 


1.02 


0.5? 


0.59 


0.71 


0.27 


0.30 


0.28 


0.24 


0.21 


37 


-1.10 


0.82 


0.63 


0.28 


0.32 


0.39 


C.29 


0.36 


0.17 


38 


0.28 


0.91 


0.71 


0.55 


0.37 


0.38 


0.36 


0.31 


0.26 


39 


0.15 


1.21 


0.31 


0.53 


0.33 


0.49 


0.17 


0.53 


-0.01 


40 


-0.43 


0.88 


0.55 


0.41 


0.33 


0.42 


0.24 


0.42 


0.10 


41 


1.74 


0.94 


0.33 


0.81 


0.25 


0.43 


0.15 


0.47 


-0.01 


42 


-0.34 


0.99 


0.47 


0.43 


0.34 


0.46 


0.22 


0.46 


0.06 


43 


-0.81 


1.09 


0.33 


0.34 


0.30 


0.49 


0.13 


0.54 


-0.06 


44 


0.45 


0.93 


0.38 


0.59 


0.30 


0.44 


0.18 


0.46 


0.02 


45 


0.92 


0.89 


0.62 


0.68 


0.33 


0.42 


0.27 


0.40 


0.14 


46 


0.77 


0.75 


0.62 


0.66 


0.32 


0.37 


0.28 


0.34 


0.17 


47 


-1.76 


0.96 


0.44 


0.18 


0.27 


0.44 


. 0.19 


0.46 


0.03 


48 


-1.57 


0.82 


0.59 


0.21 


0.29 


0.38 


0.26 


0.36 


0.15 


49 


-0.63 


0.74 


0.53 


0.37 


0.30 


0.36 


0.25 


0.34 


0.15 


50 


-0.81 


1.01 


0.47 


0.34 


0.33 


0.46 


0.22 


0.47 


0.06 


The mean score on 
standard deviation was 
The correlation between 


test 1 for this group of examinees was 
8.13. The KR-20 reliability fnr these 
the factors, obtained from the oblique 


24.14, and the 
data was 0.86. 
solution, was 



0.64. 

Table 4 shows the intercorrelation matrix for the true and estimated item 
parameters for the first dataset* As can be seen, the correlations of the 
true and estimated item parameters were 0.996 for the d^parameter, 0.731 for 
the true a on the first dimension and the estimated a for the second 
dimension, and 0.768 for the true a for the second dimension and the estimated 
a for the first dimension. Thus, the d-parameter was very well estimated, and 
the a-parameters were only moderately well estimated. 
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Table 4 



Intercorrelation Matrix for True and Estimated 
Item Parameters jIOT Dataset 1 

True Estimated" 
Variable ^ 

" d a^ • &2 ^ *1 



True d 1.000 -0.172 0.159 0.996 0.317 -0.272 

aj 1.000 -0.987 -0.189 -0.751 0.731 



a. 

Estimated d 1.000 0.358 -0.323 

1.000 -0.841 

*2 



1.000 0.177 0.768 -0.730 

0.323 
0.841 
1.000 



Table 5 shows the intercorrelation matrix of the true and estimated 
ability parameters obtained for the first dataset. As can be seen, the 
ability on dimension 1 had a correlation of 0.670 with the ability estimate on 
the second dimension, while there was a correlation of 0.704 between the true 
ability for dimension 2 and the ability estimate on dimension 1. Despite the 
correlation of 0.685 obtained for the true abilities, the estimated abilities 
were not correlated (r— 0.140). Thus, while the abilities for this group were 
moderately well estimated, the correlation between the dimensions was not 
recovered by the estimation process. 



Table 5 



Intercorrelation Matrix for True and Estimated 
Ability Parameters for Dataset 1 



True Estimated 

Variable 

h ^2 ^1 ^2 



True e 1.000 

^2 

Estimated 6. 

ei 



0.685 0.444 0.670 

1.000 0.704 0.397 

1.000 -0.140 
1.000 



The correlation of the proportion-correct difficulty index and the d- 
parameter was 0.995 (for true and estimated d-values), which is about what was 
expected. The point biserial discrimination index had a correlation of -0.131 
with the true a-parameter for dimension 1 and 0.166 for the second 
dimension. Using the a-value estimates the correlation was 0.258 for 
dimension 1 and 0.059 for dimension 2. This, too, was much as was expected. 
Since the point biserial is strongly affected by the dimensionality of the 
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items, it should not have a strong relationship to discrimination on a single 
dimension for two-dimensional data. 

Table 6 shows the intercorrelation matrix for the true and estimated item 
parameters and the varimax and oblique rotated factor loadings for the first 
dataset. As can be seen, there was a strong relationship between the factor 
loadings (both varimax and oblique rotated) and the item parameters (both true 
and estimated). The first four eigenvalues obtained from the principal 
components analysis of these data were 10.01, 1.50, 1.31, and 1.27. There 
appeared to be a strong first factor and a much smaller second factor. This 
is consistent with the high inter-dimension ability correlation for these 
data. 



Table 6 

Intercorrelation Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 1 



Item Parameters 



Factor Loadings 



Variable 



True 



Estimated 



Orthogonal Oblique 



4 



a 



1 



a/i 



II 



II 



True 


d 1.000 


-0.172 


0.159 


0.996 


0.317 


-0.272 


0.330 


-0.308 


0.329 


-0.319 


^1 
^2 


1.000 


-0.987 


-0.189 


-0.751 


0.731 


-0.852 


0.860 


-0.868 


0.872 






1.000 


0.177 


J. 768 


-0.730 


0.862 


-0.842 


0.871 


-0.862 


Estimated 


d 






1.000 


0.358 


-0.323 


0.362 


-0.341 


0.362 


-0.352 


^1 








1.000 


-0.841 


0.953 


-0.852 


0.942 


-0.89A 












1.000 


-0.852 


0.908 


-0.880 


0.908 


Orthogonal 


^2 
I 












1.000 


-0.918 


0.995 


-0.956 


II 














1.000 


-0.954 


0.994 


Oblique 


I 
















1.000 


-0.981 


II 


















1.000 



The correlation of the point blserlal Index and the factor loadings was 
0.269 and 0.091 for the two varimax rotated factors, and 0.180 and -0.009 for 
the two oblique rotated factors. The proportion-correct difficulty index had 
correlations of 0.329 and -0.323 with the varimax rotated loadings, and 0.332 
and -0.330 with the oblique rotated loadings. The proportion-correct and 
point blserlal Indexes had a correlation of 0.086. 

Dataset 2 . Table 7 shows the Item parameter estimates, item statistics, 
and factor loadings obtained for dataset 2. These da»;a were generated using 
test 1 and a group of examinees with an Inter-dimenslon ability correlation of 

0. 50. The mean score on test 1 f'>r this group was 24.49, and the standard 
deviation was 7.73. The KR-20 reliability was 0.84, which Is slightly lower 
than the KR-20 for dataset 1. The correlation between the factors, obtained 
from the oblique rotation, was -0.59, which is slightly lower than for dataset 

1, and opposite in sign. 
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Item 



Table 7 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 2 



Item Parameter 
Estimates 



Item 
Statistics 



Factor Loadings 



Orthogonal 



Oblique 





a 


^1 


^2 


V 


pbls 


I 


II 


I 


II 


1 

1 


— 1 A1 


U • J J 






0.?8 


0.23 


0.41 


0.11 


-0.40 


L 


Z • ^ J 


U • DZ 


u • ou 


n fl7 

u • O / 


0.24 


0.27 


0.36 


0.18 


-0.32 


J 


— U •Uj 


U •Z^ 


1 07 
1 •u/ 


U . H 7 


0.29 


0. 10 


0.50 


-0.07 


"0.55 


A 


0 1 "> 
Z • i 3 


n 1 
u • u 


1 1 Q 


0.85 


0.22 


0.06 


0.51 


-0.12 


-0.57 


c 
D 


— n fli 
~U • oi 


U • J / 


1 • uo 


0 14 


0.29 


0.14 


0.48 


-0.02 


-0.50 


6 


— 1 • Jl 


U • Jj 


n fli 

u • O J 




0 24 


0.12 


0.41 


-0.01 


-0.43 


7 




U •Di 


n 7 


n AO 

\J • ou 




0.30 


0.35 


0.22 


-0.30 


A 

8 


-U •4/ 


n AO 
0 •'fZ 


n QA 

U • 70 


n An 


0 10 


0.19 


0.43 


0.06 


-0.43 


9 


—0 • 3Z 


U •^D 


n 

U • 07 


n iQ 

U . J7 


0 27 


0.19 


0.37 


0.08 


-0.37 


10 


-1 •d9 


n A A 
U •^^ 


1 1 A 
i • i 0 


0 0 1 


0 ?8 


0.16 


0.48 


0.01 


-0.50 


1 1 


— U •3/ 


n 10 
U • jc. 


U • 70 




0.28 


0^12 


0.47 


-0.04 


-0.50 


12 




n A 1 


1 • yjj 




0.31 


0.18 


0.46 


0.04 


-0.47 


13 


-0 • IZ 


n 7 0 
U • / Z 


rt 7n 


n 47 


0 11 


0^33 


0.34 


0.26 


-0.27 




1 OQ 

-1 •89 


U •DD 


1 no 

i •UZ 


n 1 A 

U • 1 o 


n ?9 

• ^ 7 


0.26 


0.42 


0.14 .. 


-0.40 


15 


U .^1 


n ";i 


n QO 

U • 7U 


U • -J7 


0 12 


0^23 


0.43 


0.10 


-0.42 


Id 


1 •ZZ 


n AO 


n 


0 74 


0.28 


0^22 


0.40 


0.11 


-0.39 


1 / 


• 3D 


n Ai 

U •*♦ J 


U • OH 


0.38 


0.29 


0^20 


0.39 


0.09 


-0.38 


1 Q 

lo 


U • 


n AQ 


U • O J 


0 57 


0.31 


0^21 


0.41 


0.10 


-0.40 


19 


n /lO 
— 0 • W 


U •U 


1 QA 
i . oO 




0 27 


0^02 


0.54 


-0.19 


-0.63 


20 


U •DO 


U •DO 


n 

U . 73 


U • OH 


0 16 


0.29 


0.44 


0.17 


-0.41 


21 


— z • 


n n 


n OA 

U • 7H 


n nfi 

u . uo 


0 17 


0.10 


0.41 


-0.04 


-0.45 


22 


n 1 Q 
-0 • 19 


n AO 
U • '♦Z 


n 

U • 73 


0 4fi 

U • HU 


0.11 


0^19 


0.43 


0.06 


-0.44 


Zj 


"•U •DJ 


U • DO 


U . OU 


0 37 


0.31 


0^22 


0.42 


0.10 


-0.41 


24 


n on 
—0 .ZO 


n 1Q 


n 00 

U • 7^ 


0 4A 

U • HO 


0.10 


0.18 


0.43 


0.06 


-0.43 


25 


-0 ^72 


n An 
U •^U 


n Qi 


U • j3 


n 97 


0.18 


0.40 


0.06 


-0.40 


26 


1 .29 


A on 
0 .oO 


n 07 
U • z / 


n 7 A 

U . / 0 


0 94 

U . ^H 


0.37 


0.16 


0.38 


-0.04 


27 


0.18 


0.80 


0.35 


0.54 


0.32 


0.38 


0.27 


0.35 


-0.17 


28 


1.47 


0^71 


0.28 


0.79 


0.21 


0.37 


0.10 


0.40 


0.03 


29 


0.40 


0^93 


0.23 


0.58 


0.27 


0.43 


0.12 


0.46 


0.02 


30 


-1.02 


0^84 


0.45 


0.29 


0.28 


0.40 


0»20 


0.39 


-0.08 


31 


1.31 


1.32 


0.25 


0.73 


0.3G 


0.53 


0.11 


0.59 


0.08 


32 


0.28 


1.00 


0.50 


0.56 


0.33 


0.46 


0.21 


0.46 


-0.07 


33 


-0.79 


0.88 


0.29 


0.34 


0.26 


0.43 


0.12 


0.46 


0.03 


34 


0.63 


1.11 


0.28 


0.63 


0.30 


0.49 


0.12 


0.53 . 


0.05 


35 


1.46 


0^77 


0.42 


0.78 


0,25 


0.38 


0.19 


0.38 


-0.08 


36 


1.05 


0^79 


0.29 


0.72 


0.24 


0.40 


0.12 


0.43 


0.01 


37 


-1.21 


K23 


0.18 


0.28 


0.27 


0.50 


0.08 


0.56 


0.10 


38 


0.43 


1.14 


0.23 


0.59 


0.29 


0.50 


0.10 


0.55 


0.07 


39 


0.19 


0.93 


0.42 


0.54 


0.32 


0.42 


0.22 


0.42 


-0.09 


40 


-0.53 


0.92 


0.30 


0.39 


0.28 


0.44 


0.14 


0.46 


0.01 


41 


1.59 


0^73 


0.40 


0.82 


0.23 


0.36 


0.18 


0.35 


-0.08 


42 


-0.22 


0^78 


0.36 


0.45 


0.28 


0.39 


0.18 


0.39 


-0.06 
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Table 7(Contlnued) 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 2 



Item Parameter Item Factor Loadings 



Item Estimates Statistics Orthogonal Oblique 





d 


*1 


^2 


P 


pbls 


I 


II 


I 


II 


43 


-0.74 


0.79 


0.58 


0.35 


0.31 


0,36 . 


0.28 


0.32 


-0.19 


44 


0.34 


0.72 


0.27 


0.58 


0.25 


0.36 


0.15 


0.36 


-0.04 


45 


0.93 


1.16 


0.35 


0.68 


0.32 


0.49 


0.16 


0.52 


-0.00 


46 


0.88 


0.90 


0.51 


0.68 


0.31 


0.42 


0.23 


0.41 


-0.11 


47 


-1.74 


0.90 


0.46 


0.18 


0.25 


0.38 


0.21 


0.37 


-0.10 


48 


-1.76 


1.28 


0.27 


0.20 


0.27 


0.48 


0.14 


0.52 


0.03 


49 


-0.55 


0.69 


0.39 


0.38 


0.26 


0.35 


0.19 


0.34 


-0.09 


50 


-0.77 


0.77 


0.40 


0.34 


0.27 


0.39 


0.18 


0.39 


-0.07 



Table 8 shows the intercorrelation matrix for the true and estimated item 
p&rameters for dataset 2. The true and estimated d-parameters had a 
correlation of 0.998, indicati.ig that the d-parameter was once again very well 
estimated. The correlation between the true and estimated a-values was 0.866 
for the dimension 1 true value and the dimension 2 estimated value, and 0.834 
for the dimension 2 true value and dimension 1 estimated value. The a-values, 
then, were better estimated for dataset 2 than for dataset 1. 



Table 8 

Intercorrelation Matrix for True and Estimated 
Item Parameters for Dataset 2 



True Estimated 

Variable 

d aj^ &2 ^ ^1 *2 



0.998 0.112 -0.182 

0.180 -0.784 0.866 
0.167 0.834 -0.886 

1.000 0.115 -0.189 

1.000 -0.865 
1.000 



Table 9 shows the intercorrelation matrix of the true and estimated 
ability parameters obtained for the second dataset. The true ability on 
dimension 1 had a correlation of 0.716 with the estimated ability on dimension 
2, while there was a correlation of 0.743 for the true ability for dimension 2 
and the dimension 1 estimated ability. The Inter-dlmension ability 
correlation was 0.494 for the true values, and -0.150 for the estimated 



1.000 



True d 1.000 -0.172 0.159 

a^ 1.000 -0.987 

Estimated d 
*2 
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values. These ability parameters were estimated slightly better than were the 
parameters for dataset 1, but once again the Inter-dlmenslon ability 
correlation was not recovered during the estimation process. 



Table 9 

Intercorrelatlon Matrix for True and Estimated 
Ability Parameters for Dataset 2 



True Estimated 
Variable 

h ^1 



1.000 0.494 0.321 0.716 

1.000 0.743 -0.279 

1.000 -0.150 
1.000 



The correlation of the proportion-correct difficulty Index and the d- 
pa„-ameter was 0.993 (0.995 for the estimated d-parameter) . The point blserlal 
Index had a correlation with the true a-parameters of 0.187 for the first 
dimension and -0.134 for dlmenslon^2. Those correlations were 0.166 and 0.123 
when computed with the estimated a-values. 

Table 10 shows the Intercorrelatlon matrix for the true and estimated 
Item parameters and the factor loadings for dataset 2. Again, the 
relationship between the true and estimated Item parameters and the varlmax 
and oblique rotated factor loadings were quite strong. The first four 
eigenvalues from the principal components analysis were 9.09, 1.79, 1.30, and 
1,28. The first factor for these data was slightly smaller than for the first 
dataset, and the second factor slightly larger. This Is consistent with the 
lower Inter-dlmenslon ability correlation for this group of examinees. 



True 6 i 

. «2 

Estimated 6. 

«2 
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Table 10 



Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 2 



Item Parameters 



Factor Loadings 



Variable 



True 



Estimated 



Orthogonal Oblique 



a 



1 



a 



1 



a^ 



II 



II 



True 

Estimated 

Orthogonal 
Oblique 



d 

^1 
a2 

I, 
II 

T 
II 



1.000 -0.172 0.159 0.998 0.112 -0.182 0.201 -0.191 0.202 0.196 
1.000 -0,987-0.180 -0.784 0.866 -0.859 0.936 -0.890 -0.930 
1.000 0.167 0.834 -0.886 0.899 -0.943 0.923 0.945 
1.000 0.115 -0.189 0.204 -0.197 0.205 0.201 
1.000 -0.865 0.976 -0.876 0.963 0.911 
1.000 -0.907 0.954 -0.931 -0.955 
' ^ .. 1.000 -0.930 0.996 0.959 

1.000 -0.961 -0.996 
1.000 0.981 
1.000 



The correlation of the point biserlal Index and the factor loadings was 
0.138 and 0.185 for the varlmax rotated loadings and 0.057 and -0.109 for the 
oblique rotated loadings. The proportion-correct difficulty Index had 
correlations of 0.212 and -0.208 with the varlmax rotated loadings and 0.214 
and 0.212 with the oblique rotated loadings. The proportlc^-correct 
difficulty Index and the point biserlal Index had a correli.wlon of 0.008. 

Dataset 3 . Table 11 shows the Item parameter estimates, Item statistics, 
and factor loadings for dataset 3. These data were generated using test 1 and 
a group of examinees with an Inter-dlraenslon ability correlation of 0.35. The 
m«an score on test 1 for this group was 24.66 and the standard deviation was 
7.25. The KR-20 reliability was 0.82. This was slightly lower than for 
dataset 2. The correlation between the factors, obtained from the oblique 
rotation, was 0.52, which is slightly lower than for dataset 2, and opposite 
in sign. 
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Table 11 



Item Parameter Estimates, Item Statlistlcs, and Factor 

Loadings for Dataset 3 



Item 



Item Parameter 



Estimates 



Item 
Statistics 



Factor Loadings 



Orthogonal 



Oblique 



1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
20 
27 
28 
29 
30 
31 
32 
33 
34 
35 



a. 



-1.32 
2.42 
0.05 
2.19 
-0.78 
-1.35 
0.64 
-0.38 
-0.50 
-1.84 
-0,54 
0.27 
-0.14 
-1.64 
0.40 
1.32 
-0.56 
0.39 
-0.28 
0.62 
-3.01 
-0.16 
-0.51 
-0.08 
-0.50 
1.35 
0.20 
1.51 
0.34 
-1.07 
1 .07 
0.35 
-0.87 
0.57 
1 .50 



0.38 

0.21 

0.38 

0.20 

0.24 

0.33 

0.30 

0.21 

0,15 

0.30 

0.23 

0.23 

0.64 

0.43 

0.24 

0.26 

0.33 

0.10 

0.05 

0.37 

0.23 

0.46 

0.40 

0.31 

0.43 

1.02 

0.77 

0.98 

1 .39 

1.07 

0.87 

0.79 

1 .00 

0.98 

0.75 



0.67 

0.78 

0.75 

1.21 

0.81 

0.99 

1 .04 

0.81 

0.97 

1.06 

1.00 

1.12 

0.66 

0.68 

0.83 

0.96 

0.82 

0.89 

1.09 

0.78 

1 .07 

0.67 

0.80 

0.73 

0.80 

0.13 

0.32 

0.04 

0.03 

0.17 

0.26 

0.52 

0.40 

0.27 

0.27 



pbls 



0.23 

0.90 

0.51 

0.85 

0.33 

0.24 

0.63 

0.42 

0.40 

0.18 

0.39 

0.55 

0.47 

0.19 

0.59 

0.75 

0.38 

0.58 

0.44 

0.63 

0.07 

0.46 

0.39 

0.48 

0.39 

0.75 

0.54 

0.78 

0.56 

0.29 

0.71 

0.57 

0.33 

0.62 

0.79 



0.22 

0.16 

0.27 

0.23 

0.24 

0.26 

0.29 

0.24 

0.25 

0.24. 

0.27 

0.29 

0.31 

0.22 

0.25 

0.25 

0.26 

0.23 

0.24 

0.27 . 

0.17 

0.27 

0.28 

0.25 

0.29 

0.23 

0.26 

0.20 

0.28 

0.26 

0.25 

0.31 

0.30 

0.28 

0.21 



II 



II 



0.17 

0.09 

0.19 

0.11 

0.13 

0.15 

0.16 

0.09 

0.08 

0.13 

0.12 

0.12 

0.32 

0.19 

0.12 

0.13 

0.16 

0.04 

0.04 

0.19 

0.09 

0.22 

0.21 

0.16 

0.22 

0.45 

0.39 

0.46 

0.52 

0.47 

0.43 

0.40 

0.46 

0.45 

0.37 



0.34 
0.37 
0.37 
0.49 
0.40 
0.45 
0.47 
0.42 
0.45 
0.47 
0.45 
0.49 
0.32 
0.33 
0.41 
0.44 
0.41 
0.44 
0.48 
0.38 
0.43 
0.35 
0.38 
0.37 
0.38 
0.06 
0.16 
-0.00 
0.06 
O.IO 
0.12 
0.23 
0.18 
0.13 
0.13 



0.09 
-0.02 
0.11 
-0.03 
0.02 
0.02 
0.03 
-0.03 
-0.06 
-0.00 
-0.01 
-0.02 
0.26 
0.11 
0.00 
0.01 
0.05 
-0.09 
-0.10 
0.10 
-0.03 
0.14 
0.12 
0.07 
0.13 
0.49 
0.39 
0.52 
0.57 
0.50 
0.44 
0.37 
0.47 
0.47 
0.37 



0.33 
0.39 
0.35 
0.51 
0.41 
0.46 
0.47 
0.45 
0.49 
0.49 
0.47 
0.51 
0.26 
0.31 
0.42 
0.45 
0.41 
0.49 
0.53 
0.37 
0.45 
0.32 
0.36 
0.36 
0.36 
-0.07 
0.06 
-0.15 
-0.09 
-0.04 
-0.00 
0.14 
0.05 
-0.00 
0.03 
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Table 11 (Continued) 

It,era Parameter Estimates, Item Statistics, and Factor 
/ Loadings for Dataset 3 





I 


■4— 

jbein Parameter 


Item 




Factor Loadings 




Item 


i 


Estimates 




Statistics 


Orthogonal 


Oblique 






ai 
*1 


2 


P 


pbls 


I 


II 


I 


II 


36 


1 .05 


0.80 


0.34 


0.71 


0.55 


0.39 


0.16 


0.39 


0.06 


37 


-1 .08 


0.88 


0.34 


0.28 


0.26 


0.41 


0.17 


0.40 


0.07 


38 


0.39 


0.96 


0.34 


0.58 


0.30 


0.45 


0.17 


0.45 


-0.00 


jy 




0.90 


0.24 


0.53 


0.27 


0.43 


0.12 


0.45 


-0.00 


40 


-0.46 


0.89 


0.26 


0.40 


0.27 


0.44 


0.12 


0.45 


0.00 


41 


1.83 


1.08 


0.14 


0.82 


0.22 


0.47 


0.06 


0.51 


-0.08 


42 


-0.19 


0.97 


0.18 


0.46 


0.26 


0.45 


0.09 


0.48 


-0.03 


43 


-0.68 


0.73 


0.33 


0.35 


0.25 


0.38 


0.15 


0.38 


0.05 


44 


0.37 


0.75 


0.30 


0.58 


0.26 


0.37 


0.17 


0.37 


0.07 


45 


1.04 


0.80 


0.32 


0.71 


0.25 


0.40 


0.15 


0.41 


0.05 


46 


0.92 


0.71 


0.54 


0.69 


0.28 


0.34 


0.26 


0.30 


0.19 


47 


-1.68 


0.86 


0.39 


0.19 


0.24 


0.39 


0.18 


0.38 


0.08 


48 


-1.59 


0.80 


0.41 


0.20 


0.24 


0.38 


0.19 


0.37 


0.10 


49 


-0.58 


0.98 


0.39 


0.38 


0.30 


0.45 


0.18 


0.45 


0.06 


50 


-0.74 


0.74 


0.54 


0.34 


0.29 


0.37 


0.26 


0.33 


0.18 



Table 12 shows the intercorrelatlon matrix for the true and estimated 
item parameters for dataset 3. The true and estimated d-parameters had a 
correlation of 0.999, indicating that the d-parameter was very well 
estimated. The dimension 1 true a-values had a correlf.tion of 0.921 with the 
dimension 2 estimated a-values, while there was a correlation of 0.937 between 
the dimension 2 true a-values and the dimension 1 estimated a-values. The a- 
values, then, were fairly well estimated for these data. 
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Table 12 



Intercorrelation Matrix for True and Estimated 
Item Parameters for Dataset 3 



Variable 



True 



ar 



Estimated 



a. 



True 



^1 

82 

Estimated d 
a 



1 



a^ 



1.000 



-0.172 
1.000 



0.159 


0.999 


0.131 


-0.207 


-0.987 


-0.164 


-0.929 


0.921 


1.000 


0.153 


0.937 


-0.915 




1.000 


0.127 


-0.201 






1.000 


-0.936 








1.000 



Table 13 shows the intercorrelation matrix of the true and estimated 
ability parameters obtained for dataset 3. The true abilities for dimension 
had a correlation of 0.772 with dimension 2 of the estimated abilities. The 
dimension 2 true abilities had a correlation of 0.779 with the dimension 1 
estimated abilities. The inter-dimension ability correlation was 0.345 for 
the true abilities and -0.087 for the estimated abilities. 



Table 13 



Intercorrelation Matrix for True and Estimated 
Ability Parameters for Dataset 3 



True 



Estimated 



Variable 



True e, 1.000 0.345 0.231 0.772 

ei 1.000 0.779 0.229 

Estimated 67 1.000 -0.087 

1.000 

The correlation between the d-parameter and the proportion-correct 
difficulty index was 0.995 (0.993 for the d-pararaeter estimates). The 
correlation of the point blserial discrimination i. lex with the true a- 
parameters was -0.134 for dimension 1 and 0.171 for dimension 2. When 
estimated a-values were used, these correlations were 0.261 and -0.079. 

Table 14 shows the intercorrelation matrix for the true and estimated 
item parameters and the rotated factor loadings for dataset 3. As was the 
case previously, there was a strong relationship between the true and 
estimated item parameters and both sets of rotated loadings. The first four 
eigenvalues from the principal components analysis of these data were 7.92, 
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2.08, 1.43, and 1.29. The first factor for these data was smaller than for 
the previous datasets, and the second factor was somewhat larger. 



Table 14 

Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 3 



Item Parameter 



Factor Loadings 



Variable 



True 



Estimated 



Orthogonal 



Oblique 



'1 



'1 



a.. 



II 



II 



True 

Estimated 

Orthogonal 
Oblique 



d 

^1 

^2 
d 



I 
II 

I 
II 



1.000 -0.172 0.159 0.999 0.131 -0.207 0.U9 -0.Z15 0.164 -0.204 
1.000 -0.987 -0.164 -0.929 0.921 -0.946 0.949-0.953 0.955 
1.000 0.153 0.937 -0.915 0.959 -0.942 0.961 -0.952 
1.000 0.127-0.201 0.145-0.200 0.160-0.199 
1.000 -0.936 0.988 -0.949 0.987 -0.965 
1.000 -0.93A 0.989 -0.957 0.984 
1.000 -0.954 0.997 -0.972 
1.000 -0.972 0.997 
1.000 -0.986 
1.000 



The correlation of the point blserlal Index and the factor loadings was 
0.299 and -0.050 for the varlmax rotation, and 0.247 and -0.106 for the 
oblique rotation. The proportion-correct difficulty index had correlations of 
0 147 and -0.214 with the varimax rotated loadings, and 0.162 and -O.ZUJ with 
the oblique rotated loadings. The proportion-correct difficulty and point 
blserlal discrimination indexes had a correlation of -0.101. 

Data set 4 . Table 15 shows the item parameter estimates, item statistics, 
and factor loadings for dataset 4. These data were generated using test 1 and 
a group of examinees with an inter-dimension ability correlation of 0.00. The 
mean score on test 1 for this group was 24.61 and the standard deviation was 
6.52. The KR-20 reliability was 0.77, which is somewhat lower than for 
dataset 3. The correlation between the factors, obtained from the oblique 
rotation, was 0.36, which is slightly lower than was the case for dataset 3. 
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Table 15 



Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 4 



Item 



Item Parameter 



Estimates 



Item 



Statistics 



Factor Loadings 



Orthogonal 



Oblique 



ai 



ar 



pbis 



II 



II 



1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 

35 



-1.33 
2.42 
0.03 
2.15 
-0.79 
-1.35 
0.63 
-0.39 
-0.51 
-1.88 
-0.56 
0.25 
-0.15 
-1.65 
0.41 
1.28 
-0.57 
0.39 
-0.27 
0.62 
-2.98 
-0.16 
-0.53 
-0.08 
-0.51 
1.28 
0.19 
1.46 
0.29 
-1.07 
1.04 
0.34 
-0.88 
0.58 
1.50 



0.32 

0.08 

0.21 

0.03 

0.16 

0.25 

0.18 

0.08 

0.03 

0.19 

0.14 

0.09 

0.49 

0.30 

0.12 

0.22 

0.19 

0.06 

0.0 

0.22 

0.18 

0.34 

0.24 

0.17 

0.23 

0.90 

0.76 

0.86 

1.04 

1.08 

0.74 

0.77 

1.01 

0.94 

0.69 



0.63 

0.73 

0.80 

1.13 

0.78 

0.93 

1 .00 

0.80 

0.94 

1 .08 

1.01 

1.10 

0.63 

0.67 

0.79 

0.81 

0.80 

0.78 

1 .04 

0.82 

0.97 

0.70 

0.81 

0.72 

0.83 

0.0 

0.18 

0.01 

0.11 

0.06 

0.21 

0.37 

0.33 

0.11 

0.20 



0.23 

0.90 

0.51 

0.85 

0.33 

0.24 

0.63 

0.41 

0.39 

0.17 

0.39 

0.55 

0.47 

0.18 

0.59 

0.75 

0.38 

0.59 

0.44 

0.63 

0.07 

0.46 

0.39 

0.48 

0.39 

0.75 

0.54 

0.78 

0.56 

0.29 

0.72 

0.57 

0.32 

0.62 

0.80 



0.20 

0.13 

0.23 

0.18 

0.21 

0.23 

0.24 

0.20 

0.20 

0.21 

0.24 

0.24 

0.26 

0.18 

0.20 

0.21 

0.22 

0.19 

0.21 

0.23 

0.15 

0.24 

0.23 

0.21 

0.23 

0.18 

0.22 

0.17 

0.25 

0.23 

0.21 

0.26 

0.28 

0.23 

0.18 



0.15 
0.04 
0.11 
0.03 
0.08 
0.12 
0.09 
0.04 
0.02 
0.08 
0.07 
0.05 
0.25 
0.13 
0.06 
0.12 
0.10 
0.03 
-0.01 
0.12 
0.08 
0.17 
0.12 
0.09 
0.12 
0.43 
0.39 
0.42 
0.48 
0,47 
0.38 
0.39 
0.46 
0.44 
0.35 



0.33 
0.35 
0.39 
0.47 
0.40 
0.43 
0.46 
0.41 
0.45 
0.48 
0.46 
0.48 
0.32 
0.33 
0.40 
0.39 
0.40 
0.41 
0.48 
0.40 
0.40 
0.36 
0.40 
0.37 
0.40 
-0.00 
0.09 
-0.00 
0.06 
0.05 
0.09 
0.17 
0.16 
0.06 
0.10 



0.10 
-0.03 
0.04 
-0.06 
0.01 
0.04 
0.01 
-0.04 
-0.07 
-0.01 
-0.02 
-0.04 
0.20 
0.07 
-0.01 
0.04 
0.02 
-0.05 
-0.10 
0.04 
0.00 
0.11 
0.05 
0.02 
0.04 
0.45 
0.39 
0.44 
0.49 
0.49 
0.38 
0.38 
0.45 
0.46 
0.35 



0.32 
0.36 
0.39 
0.49 
0.40 
0.43 
0.47 
0.42 
0.47 
0.49 
0.47 
0.50 
0.29 
0.32 
0.41 
0.39 
0.40 
0.42 
0.50 
0.40 
0.41 
0.35 
0.40 
0.37 
0.40 
-0.09 
0.02 
-0.09 
-0.03 
-0.04 
0.02 
0.10 
0.07 
-0.03 
0.03 
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Table 15(C0ntlnued) 

Item Paramett'.r Estimates, Item Statistics, and Factor 

Loadings for Dataset 4 





Item Parameter 


Item 






Factor Loadings 




Item 




Estimates 




Statistics 


Orthogonal 


Oblique 




d 


ai 

1 


Sin 

2 


P 


pbls 


I 


II 


I 


II 


36 


1 .07 


0.82 


0.13 


0.72 


0.21 


0.41 


0.06 


0.42 


-0.02 


37 


-1.09 


0.94 


0.18 


0.28 


0.23 


0.43 


0.10 


0.43 


0.02 


38 


0.35 


0.90 


0.26 


0.57 


0.26 


0.43 


0.13 


0.43 


0.05 


39 


0.14 


0.89 


0.20 


0.53 


0.25 


0.43 


0.10 


0.43 


0.02 


40 


-0.51 


0.92 


0.13 


0.39 


0.23 


0.45 


0.06 


0.46 


-0.02 


41 


1.77 


1.02 


0.10 


0.81 


0.20 


0.46 


0.05 


0.47 


-0.04 


'42 


-0.19 


0.93 


0.03 


0.46 


0.21 


0.45 


0.02 


0.47 


-0.07 


43 


-0.67 


0.79 


0.16 


0.36 


0.21 


0.40 


0.07 


0.41 


-0.00 


44 


0.37 


0.73 


0.11 


0.58 


0.20 


0.38 


0.06 


0.39 


-0.01 


45 


1.04 


0.82 


0.22 


0.71 


0.23 


0.41 


0.11 


0.41 


0.03 


46 


0.93 


0.72 


0.38 


0.59 


0.24 


0.36 


0.18 


0.35 


0.12 


47 


-1.77 


0.93 


0.27 


0.18 


0.21 


0.41 


0.13 


0.41 


0.06 


48 


-1.59 


0.83 


0.23 


0.20 


0.20 


0.39 


0.12 


0.38 


0.05 


49 


-0.59 


0.86 


0.18 


0.38 


0.23 


0.41 


0.09 


0.42 


0.02 


50 


-0.76 


0.72 


0.40 


0.34 


0.25 


0.36 


0.21 


0.34 


0.15 




Table 16 


shows the 


Intercorrelatlon matrix 


obtained for 


the true 


and 



estimated item parameters for dataset 4, The correlation between the true and 
estimated d-parameters was 0,999, as was the case with dataset 3. There was a 
correlation of 0.920 between the dimension 1 true a-values and the dimension 2 
estimated a-values, while the dimension 2 true a-values and dimension 1 
estimated a-values had a correlation of 0.937 . These values are almost 
identical to those obtained for dataset 3. 
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Table 16 

Intercorrelation Matrix for True and Estimated 
Item Parameters for Dataset 4 



Variable 



True 



Estimated 



True 



d 



'1 
^2 

Estimated d 

^1 
ao 



1.000 



■0.172 
1.000 



0.159 
-0.987 
1.000 



0.999 
•0.165 
0.153 
1.000 



0.133 
0.929 
0.937 
0.129 
1.000 



-0.205 
0.92'^ 
-0.914 
-0.199 
-0.937 
1.000 



Table 17 shows the intercorrelation matrix obtained for the true and 
estimated ability parameters for dataset 4. The true abilities for dimension 
1 had a correlation of 0.802 with the dimension 2 ability estimates, while 
there was a correlation of 0.809 between the dimension 2 true abilities and 
the dimension 1 ability estimates. The inter-dimension ability correlation 
was 0.007 for the true values and -0.048 for the ability estimates. 



Table 17 



Intercorrelation Matrix for True and Estimated 
Ability Parameters for Dataset 4 



Variable 



True 



Estimated 



True 6 

0 

Estimated 6 
6 



1 



1 



1.000 



0.007 
1.000 



0.058 
0.809 
1.000 



0.802 
0.060 
-0.048 
1.000 



The proportion-correct difficulty index had a correlation of 0.995 with 
the true d-parameter, and a correlation of 0.993 with the d-parameter 
estimates. The correlation between the point blserial index and the true a- 
parameters was -0.146 for dimension 1 and 0.183 for dimension 2. These values 
were 0.274 and -0.097 for the estimated a values. 

Table 18 shows the intercorrelation matrix for the true and estimated 
item parameters and the rotated factor loadings for dataset 4„ As has been 
the case all along, there was a strong relationship between the item 
parameters and estimates and both sets of mtated factor loadings. The first 
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four eigenvalues from the principal components analysis for dataset 4 were 
6.32, 2.74, 1.42, and 1.32. 

Table 18 

Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 4 



Item Parameters Factor Loadings 

Variable True Estimated Orthogonal Oblique 

^ d a^ a2 d aj a2 I II I II 



True 


d 1.000 


-0.172 


0.159 


0.999 


0.133 


-0.205 


0.147 


-0.217 


0.163 


-0.203 




^1 

^2 
d 


1.000 


-0.987 


-0.165 


-0.929 


0.920 


-0.945 


0.949 


-0.953 


0.976 






1.000 


0.153 


0.937 


-0.914 


0.958 


-0.942 


0.962 


-0.953 


Estimated 






1.000 


0.129 


-0.199 


0.144 


-0.211 


0.159 


-0.198 


^1 








1.000 


-0.937 


0.988 


-0.949 


0.987 


-0.965 












1.000 


-0.939 


0.989 


-0.957 


0.985 


Orthogonal 


^2 
I 












1.000 


-0.955 


0.998 


-0.973 


II 














1.000 


-0.972 


0.998 


Oblique 


I 
















1.000 


-0.986 


II 


















1.000 



The point biserial index had correlations of 0.312 and -0.066 v/ith the 
varimax rotated factor loadings. The correlations between the point blserials 
and the oblique rotated factor loadings were 0.262 and -0.121. The 
correlations between the proportion-correct index and the varimax rotated 
factor loadings were 0.146 and -0.217, while correlations of 0.163 and -0.203 
were obtained between the point blserials and the oblique rotated factor 
loadings. The correlation between the proportion-correct difficulty index and 
the point biserial discrimination index was -0.110. x „ 

Test 2 Analyses 

Dataset 5 . Table 19 shows the item parameter estimates, item statistics, 
and rotated factor loadings for -"itaset 5. These data were generated using 
test 2 and a group of examinees having an inter-dimension ability correlation 
of 0.70. The mean score on test 2 for these examinees was 24.19, while the 
standard deviation was 9.00. The KR-20 reliability was 0.89. The correlation 
between factors, obtained from the oblique rotation, was 0.62. 
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Table 19 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 5 



Item Parameter 
Estimates 



Item 
Statistics 



Factor Loadings 



Orthogonal 



ai 



^2 



pbls 



II 



Oblique 



II 



1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 



-1.34 
2.24 
-0.14 
2.04 
-0.83 
-1.68 
0.54 
-0.48 
-0.54 
-1.74 
-0.56 
0.29 
-0.21 
-1.76 
0.41 
1.21 
-0.79 
0.35 
-0.33 
0.62 
-3.20 
-0.17 
-0.55 
-0.22 
-0.58 
1.22 
0.07 
1.50 
0.30 
-1.04 
1.09 
0.31 
-0.87 
0.51 
1.80 
1.14 
-1.03 
0.35 



1.04 

0.63 

0.56 

1.06 

0.94 

0.49 

0.72 

0.83 

0.87 

0.76 

1.09 

0.80 

0.76 

0.64 

0.97 

0.86 

1.98 

0.49 

0.63 

0.84 

0.24 

0.91 

0.99 

0.74 

0.66 

0.87 

0.73 

0.71 

0.59 

0.93 

0.71 

1.04 

0.63 

0.64 

0.20 

0.90 

0.97 

1.37 



0.59 

1.12 

1.10 

0.34 

0.70 

1.29 

0.80 

0.63 

0.85 

0.75 

0.41 

0.84 

1.06 

0.80 

0.71 

0.85 

0.20 

1.38 

0.77 

0.67 

1.21 

0.83 

0.60 

0.94 

0.93 

0.72 

0.70 

1.13 

1.04 

0.56 

0.84 

0.74 

0.66 

0.90 

1.82 

0.58 

0.48 

0.49 



0.25 

0.86 

0.47 

0.84 

0.34 

0.21 

0.61 

0.40 

0.39 

0.18 

0.39 

0.56 

0.46 

0.18 

0.58 

0.73 

0.38 

0.56 

0.43 

0.63 

0.07 

0.47 

0.39 

0.46 

0.38 

0.73 

0.51 

0.76 

0.56 

0.29 

0.71 

0.56 

0.32 

0.60 

0.77 

0.72 

0.30 

0.57 



0.34 

0.28 

0.36 

0.26 

0.37 

0.31 

0.35 

0.35 

0.38 

0.29 

0.35 

0.38 

0.39 

0.28 

0.38 

0.36 

0.39 

0.36 

0.34 

0.35 

0.18 

0.40 

0.37 

0.38 

0.35 

0.34 

0.35 

0.34 

0.35 

0.33 

0.33 

0.40 

0.30 

0.35 

0.28 

0.32 

0.33 

0.40 



0.44 
0.25 
0.24 
0.52 
0.43 
0.22 
0.33 
0.35 
0.39 
0.40 
0.50 
0.37 
0.36 
0.34 
0.40 
0.36 
0.56 
0.21 
0.30 
0.40 
-0.03 
0.43 
0.43 
0.32 
0.29 
0.40 
0.34 
0.29 
0.25 
0.42 
0.34 
0.49 
0.33 
0.26 
0.12 
0.45 
0.42 
0.54 



0.27 

0.45 

0.47 

0.08 

0.30 

0.48 

0.37 

0.34 

0.37 

0.26 

0.17 

0.37 

0.41 

0.30 

0.34 

0.38 

0.18 

0.51 

0.36 

0.29 

0.61 

0.33 

0.29 

0.42 

0.42 

0.30 

0.34 

0.46 

0.45 

0.26 

0.35 

0.28 

0.27 

0.44 

0.52 

0.21 

0.25 

0.22 



0.48 
0.18 
0.16 
0.62 
0.45 
0.13 
0.31 
0.34 
0.38 
0.42 
0.57 
0.36 
0.33 
0.34 
0.40 
0.35 
0.65 
0.11 
0.27 
0.42 

-0.21 
0.45 
0.46 
0.28 
0.24 
0.42 
0.32 
0.23 
0.18 
0.44 
0.33 
0.53 
0.33 
0.20 

-0.00 
O.50 
0.45 
0.61 



0.07 
0.38 
0.41 

-0.20 
0.11 
0.44 
0.24 
0.19 
0.22 
0.08 

-0.08 
0.22 
0.27 
0.15 
0.18 
0.24 

-0.11 
0.48 
0.25 
0.11 
0.72 
0.14 
0.09 
0.31 
0.33 
0.12 
0.21 
0.37 
0.38 
0.07 
0.21 
0.05 
0.13 
0.36 
0.54 

-0.01 
0.06 

-0.04 
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Table 19(Contlnued) 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 5 



Item Parameter Item Factor Loadings 



Item Estimates Statistics Orthogonal Oblique 





d 


*1 


^2 


P 


pbis 


I 


II 


I 


II 


39 


0.19 


0.89 


0.57 


0.54 


0.35 


0.45 


0.22 


0.50 


0.01 


40 


-0.49 


1.03 


0.60 


0.40 


0.38 


0.49 


0.23 


0.55 


-0.01 


41 


1.70 


1.16 


0.48 


0.79 


0.32 


0.50 


0.19 


0.57 


-0.06 


42 


-0.36 


2.00 


0.07 


0.45 


0.39 


0.57 


0.15 


0.67 


-0.14 


43 


-0.91 


0.94 


0.74 


0.32 


0.37 


0.47 


0.28 


0.50 


0.06 


44 


0.32 


0.99 


0.56 


0.57 


0.37 


0.44 


0.26 


0.48 


0.05 


45 


0.91 


0.98 


0.54 


0.68 


0.35 


0.49 


0.20 


0.55 


-0.04 


46 


0.9A 


0.51 


1.16 


0.68 


0.33 


0.20 


0.50 


0.11 


0.46 


47 


-1.86 


0.77 


0.85 


0.17 


0.31 


0.29 


0.42 


0.24 


0.32 


48 


-1.60 


0.93 


0.49 


0.20 


0.29 


0.44 


0.19 


0.49 


-0.03 


49 


-0.62 


0.77 


0.84 


0.38 


0.37 


0.34 


0.39 


0.31 


0.26 


50 


-0.84 


0.76 


0.99 


0.34 


0.37 


0.32 


0.43 


0.28 


0.31 



Table 20 shows the Intercorrelatlon matrix obtained for the true and 
estimated Item parameters for dataset 5. The correlation between the true and 
estimated d-parameters was 0.997 • The correlations of the true and estimated 
a-parameters for these data were 0.198 for dimension 1 and 0.167 for dimension 
2. These values are In marked contrast to the high values obtained for test 
1. Here, there Is no significant correlation between the true and estimated 
Item discrimination parameters > 



Table 20 



Intercorrelatlon Matrix for True and Estimated 
Item Parameters for Dataset 5 



Variable 






True 






Estimated 








d 


^1 




d 


H 


*2 


True 

Estimated 


d 

H 

«2 
d 

»2 


1.000 


-0.048 
1.000 


0.076 
-0.985 
1.000 


0.997 
-0.036 
0.067 
1.000 


0.029 
0.198 
-0.159 
0.012 
1.000 


0.088 
-0.176 

0.167 

0.096 
-0.837 

1.000 
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Table 21 shows the Intercorrelatlon matrix for the true and estimated 
ability parameters for dataset 5. As can be seen, the true ability values on 
the two dimensions had abbut equal correlations with the dimension 1 estimated 
abilities (0.592 for dimension 1, 0.597 for dimension 2). The correlations of 
the true abilities with the dimension 2 ability estimates were also almost 
equal (0.468 for dimension 1, 0.507 for dimension 2) and both were lower than 
the correlations with the dimension 1 estimates. The Inter-dlmenslon ability 
correlation was 0.687 fot the true values and -0.203 for the estimated values. 



Table 21 

Intercorrelatlon Matrix for True and Estimated 
Ability Parameters for Dataset 5 



True Estimated 

Variable ■ 

Ql ^2 ^1 ^2 



True e, l.OUO 0.687 0.592 0.468 

qI 1.000 0.597 0.507 

Estimated 6^ 1.000 -0.203 

J 1.000 

^2 ^ 

The correlation between the proportion-correct Index and the d-parameter 
was 0.994 (0.992 with the d-parameter estimates). The correlation between the 
point blserlal index and the true a-parameters • s AB6 for dimension 1 and 
-0.142 for dimension 2. When the a-parameter estimates were used, these 
correlations were 0.474 and -0.252. 

Table 22 shows the Intercorrelatlon matrix for the true and estimated 
item parameters and the rotated factor loadings for dataset 5. Interestingly, 
the factor loadings (both rotations) are strongly related to the estimated a- 
parameters, but not to the true a-parameters. The first four eigenvalues from 
the principal components analysis of dataset 5 were 12.32, 1.23, 1.21, and 
1.18. The first factor for this dataset is larger than for the corresponding 
dataset from the test 1 analyses (dataset 1). 
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Table 22 

Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 5 



Item Parameters Factor Loadings 



Variable True Estimated Orthogonal Oblique 





. d 


*1 


*2 


d 


*1 


^2 


I 


II 


I 


II 


True , • d 


1.000 


-0.048 


0.076 


0.997 


0.029 


0.088 


0.113 


-0.061 


0.105 


-0.079 


*i 




1.000 


-0.985 


-0.036 


0.198 


-0.176 


0.244 


-0.195 


0.238 


-0.215 








1.000 


0.067 


-0.159 


0.167 


-0.215 


0.181 


-0.211 


0.196 


Estimated 62 








1.000 


0.012 


0.096 


0.116 


-0.067 


0.108 


-0.085 


ai 










1.000 


-0.837 


0.860 


-0.760 


0.851 


-0.806 


^2 












1.000 


-0.869 


0.905 


-0.885 


0.908 


Orthogonal t 














1.000 


-0.925 


0.998 


-0.966 


II 












{ 




1.000 


-0.949 


0.992 


Oblique I 


















1.000 


-0.982 


II 




















1.000 



The point blserlal Index had correlations of 0.509 (dimension 1) and 
-0.186 (dimension 2) with the varlmax rotated factor loadings, and 0.456 
(dimension 1) and -0.298 (dimension 2) with the oblique rotated factor 
loadings. The proportion-correct Index had correlations of 0.085 and -0.042 
with the varlmax rotated loadings, and 0.078 and -0.057 with the oblique 
rotated factor loadings. The correlation betwean the proportion-correct and 
point blserlal indexes was 0.120. 

Dataset 6 . Table 23 shows the Item parameter estimates, Item statistics, 
and rotated factor loadings for dataset 6. These data were generated using 
test 2 and a group of examinees with an inter-dlmenslon ability correlation of 
0*50. The mean score on test 2 for this group was 24.01, and the standard 
deviation was 8.54. The KR-20 reliability was 0.87. The correlation between 
factors, obtained from the oblique rotation, was -0.19. 
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Table 23 



Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 6 



Item 



Item Parameter 



Estimates 



Item 
Statistics 



pbls 



Factor Loadings 



Orthogonal 
"l n' 



Oblique 



II 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 



-1.39 
2.22 
-0.12 
2.78 
-0.86 
-1.36 
0.44 
-0.44 
-0.49 
-1.76 
-0.58 
0.29 
-0.21 
-2.74 
0..40 
1.09 
-0.58 
0.68 
-0.38 
0.65 
-3.04 
-0.24 
-0.69 
-0.21 
-0.73 
1.19 
0.05 
1.54 
0.33 
-1.02 
0.92 
0.28 
-1.02 
0.49 
1.45 
1.06 
-1.21 
0.29 
0.13 



0.65 

0.72 

0.72 

0.03 

0.94 

0.91 

0.75 

0.67 

0.62 

0.82 

0.85 

0.83 

0.87 

2.00 

0.68 

0.61 

1.03 

0.13 

0.82 

0.80 

1.05 

0.91 

0.84 

1.26 

0.72 

0.89 

1.17 

1.02 

0.80 

0.71 

0.81 

0.96 

0.84 

1.27 

0.83 

1.10 

1.36 

0.74 

0.77 



0.72 
0.98 
0.91 
2.00 
0.65 
0.64 
0.98 
0.71 
0.89 
0.67 
0.90 

i.oi 

0.72 
0.02 
0.86 
1.12 
0.79 
2.00 
0.76 
- 0.73 
0.79 
0.81 
0.82 
0.64 
0.75 
0.72 
0.64 
0.65 
0.93 
0.97 
0.71 
0.72 
0.70 
0.64 
0.73 
0.62 
0.59 
0.87 
0.98 



0.23 

0.87 

0.48 

0.84 

0.33 

0.24 

0.59 

0.40 

0.40 

0.18 

0.38 

0.56 

0.46 

0.17 

0.59 

0.71 

0.38 

0.58 

0.42 

0.64 

0.07 

0.45 

0.36 

0.46 

0.35 

0.73 

0.51 

0.78 

0.57 

0.30 

0.69 

0.56 

0.29 

0.60 

0.78 

0.70 

0.28 

0.56 

0.53 



0.26 

0.26 

0.34 

0.27 

0.31 

0.29 

0.36 

0.30 

0.32 

0.26 

0.36 

0,38 

0.33 

0.28 

0.33 

0.32 

0.36 

0.35 

0.33 

0.32 

0.21 

0.36 

0.33 

0.36 

0.31 

0.31 

0.35 

0.29 

0.36 

0.33 

0.30 

0.34 

0.30 

0.35 

0.29 

0.32' 

0.34 

0.34 

0.36 



0.28 

0.27 

0.25 

0.08 

0.42 

0.39 

0.31 

0.30 

0.24 

0.36 

0.35 

0.30 

0.37 

0.64 

0.28 

0.23 

0.43 

0.08 

0.36 

0.35 

0.34 

0.37 

0.36 

0.51 

0.31 

0.37 

0.49 

0.42 

0.31 

0.28 

0.34 

0.41 

0.40 

0.50 

0.30 

0.47 

0.54 

0.30 

0.30 



0.29 
0.38 
0.43 
0.59 
0.21 
0.23 
0.39 
0.30 
0.39 
0.24 
0.36 
0.44 
0.28 
-0.01 
0.37 
0.46 
0.28 
0.64 
0.31 
0.29 
0.30 
0.33 
0.31 
0.20 
0.31 
0.28 
0.19 
0.21 
0.40 
0.39 
0.28 
0.27 
0.23 
0.19 
0.33 
0.18 
0.16 
0.37 
0.41 



0.39 

0.43 

0.43 

0.35 

0.48 

0.46 

0.47 

0.41 

0.41 

0.44 

0.49 

0.48 

0.47 

0.57 

0.43 

0.43 

0.52 

0.38 

0.47 

0.46 

0.45 

0.49 

0.47 

0.55 

0.43 

0.47 

0.53 

0.48 

0.47 

0.44 

0.44 

0.49 

0.47 

0.54 

0.43 

0.51 

0.56 

0.45 

0.47 



-0.05 
-0.13 
-0.18 
-0.42 
0.10 
0.07 
-0.11 
-0.04 
-0.15 
0.04 
-0.06 
-0.16 
0.01 
0.42 
-0.12 
-0.22 
0.05 
-0.45 
-O.Ol 
-0.00 
-0.02 
-0.02 
-0.02 
0.17 
-0.05 
0.02 
0.17 
0.10 
-0.12 
-0.13 
-0.00 
0.05 
0.08 
0.17 
-0.07 
0.15 
0.22 
-0.10 
-0.13 
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Table 23(Contlnued) 

Item Parameter Estimates^ Item Statistics^ and Factor 

loadings for Dataset 6 



Item Parameter Item Factor Loadings 



Item Estimates Statistics Orthogonal Oblique 





d 


^1 


*2 


P 


pbls 


I 


II 


I 


II 


40 


-0.58 


0.72 


0.81 


0.38 


0.32 


0.33 


0.31 


0.45 


-0.04 


41 


1.84 


0.46 


1.28 


0.81 


0.28 


0.12 


0.53 


0.36 


-0.34 


42 


-0.32 


0.65 


1.02 


0.44 


0.35 


0.23 


0.45 


0.43 


-0.21 


43 


-0.93 


0.38 


1.63 


0.34 


0.33 


0.12 


0.56 


0.38 


-0.37 


44 


0.33 


0.93 


0.93 


0.57 


0.37 


0.34 


0.40 


0.49 


-0.10 


43 


0.94 


1.02 


0.64 


0.69 


0.32 


0.39 


0.26 


0.48 


0.05 


46 


0.80 


0.63 


0.85 


0.67 


0.31 


0.27 


0.37 


0.42 


-0.12 


47 


-1.82 


0.98 


0.84 


0.18 


0.30 


0.41 


0.27 


0.50 


0.05 


48 


-1.94 


1.36 


0.57 


0.18 


0.30 


0.53 


0.13 


0.54 


0.24 


49 


-0.71 


0.97 


0.98 


0.63 


0.38 


0.39 


0.36 


0.52 


-0.04 


50 


-0.82 


0.94 


0.96 


0.34 


0.37 


0.39 


0.35 


0.52 


-0.02 



Table 24 shows the Intercorrelatlon matrix for the true and estimated 
Item parameters for dataset 6. The correlation between the true and estimated 
d-parameters was 0t986> which Is somewhat lower than was the case with dataset 
5, The true a-parameters for dimension 1 had a correlation of 0,109 with the 
dimension 2 estimated a-values, while the dimension 2 true a-values had a 
correlation of 0t056 with the dimension 1 estimated a-valuest Again, there Is 
no significant correlation between the true and estimated a-parameters. 



Table 24 

Intercorrelatlon Matrix for True and Estimated 
Item Parameters for Dataset 6 



True Estimated 
Variable 



ai aj d aj a- 



True d 1,000 -0,048 0.076 

aj 1.000 -0.985 



^2 

Estimated d 

^1 
^2 



KOOO 



0.989 


-0.379 


0.335 


0.021 


-0.065 


0.109 


0.054 


0.056 


-0.076 


1.000 


-0.469 


0.420 




1.000 


-0.840 






1 .000 
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Table 25 shows the Intercorrelatlon matrix for the true and estimated 
abilities for dataset 6. As can be seen, the true abilities had slightly 
higher correlations with the dimension 2 ability estimates than with the 
dimension 1 ability estimates. Each true ability parameter had about equal 
correlations with the two sets of ability parameter estimates. The inter- 
dimension ability correlations was 0.493 for the true abilities and -0.378 for 
the estimated abilities. 



Table 25 



Intercorrelatlon Matrix for True and Estimated 
Ability Parameters for Dataset 6 



True Estimated 
Variable - — 

ei ^2 ^ ^2 



True e, 1.000 0.493 0.424 0.451 

^^""^ 1.000 0.446 0.465 

Estimated LOOO -0.378 



^2 



There was a correlation of 0.993 between the proportion-correct 
difficulty index and the true d-parameter. The correlation was 0.^83 for the 
estimated d-parameter. The point blserlaX discrimination index had 
correlations of 0.158 and -0.096 with the true a-parameters and correlations 
of 0.032 and 0.137 with the estimated a-parameters. 

Table 26 shows the Intercorrelatlon matrix for the true and estimated 
item parameters and the rotated factor loadings for dataset 6. As was the 
case with dataset 5. there was a strong relationship between the estimated a- 
parameters and both sets of rotated factor loadings, but no significant 
relationship between the true a-parameters and the factor loadings. The first 
four eigenvalues from the principal components analysis of dataset 6 were 
11.18. 1.28, 1.25, and 1.22. There is a large first factor, and the second 
factor is almost nonexistent. 
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Table 26 

Intercorrelatlon Matrix for True and Estimated, Item 
Parameters and Factor Loadings for Dataset .6 ^ .. 

Item Parameters Factor Loadings 



Variable True Estimated Orthogonal Oblique 





d 




*2 


d 


«1 




I 


II 


I 


II 


True 


d 1.000 


-0.048 


0.076 


0.989 


-0.379 


0.335 


-0.370 


0.382 


-0.306 


-0.382 






1.000 


-0.985 


-0.021 


-0.065 


0.109 


-0.008 


0.045 


0.036 


-0.030 






1.000 


0.054 


0.056 


-0.076 


-0.003 


-0.012 


-0.021 


0.005 


Estimated 


d^ 






1.000 


-0.469 


0.420 


-0.439 


0.449 


-0.366 


-0.450 










1.000 


-0.840 


0.953 


-0.886 


0.897 


0.928 












1.000 


-0.852 


0.918 


-0.659 


-0.902 


Orthogonal 


? 












1.000 


-0.944 


0.926 


0.982 


II 














1. 000 


-0.750 


-0.990 


Oblique 


I 
















1.000 


0.837 


II 


















1.000 



The correlations of the point blserlals with the varlraax rotated loadings 
were 0.074 and 0.194. With the oblique rotated loadings, the correlations 
were 0.371 and -0.079. The proportion-correct difficulty Index had 
correlations of -0.367 and 0.379 with the varlmax rotated loadings, and 
correlations of -0.303 and -0.379 with the oblique rotated loadings. The 
correlation of the proportion-correct difficulty and point blserlal 
discrimination Indexes was 0.094. 

Dataset 7. Table 27 shows the Item parameter estimates. Item statistics, 
and rotated factor loadings for dataset 7. These data were generated using 
test 2 and a group of examinees having ai. Inter-dlmenslon ability correlation 
of 0.35. The mean score on test 2 for this group was 24.07, and the standard 
deviation was 8.20. The KR-20 reliability was 0.86. The correlation between 
factors, obtained from the oblique rotation, was 0.23. 
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Table 27 



Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 7 





Item Parameter 


Item 


Factor Loadings 


Item 


Estimates 


Statistics 


Orthogonal Oblique 




4 ai ^2 


p pbls 


I II I II 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 



-1.39 
2.27 
-0.12 
2.28 
-0.84 
-1.33 
0.45 
-0.42 
-0.47 
-1.74 
-0.53 
0.30 
-0.18 
-2.70 
0.41 
1.23 
-0.56 
0.82 
-0.38 
0.67 
-3.01 
-0.22 
-0.66 
-0.21 
-0.72 
1.24 
0.08 
1.53 
0.33 
-0.98 
0.97 
0.30 
-1.00 
0.47 
1.47 
1.03 
-1.29 
0.29 
0.15 
-0.56 
2.55 
-0.29 



0.53 

0.73 

0.85 

0.27 

0.82 

0.78 

0.74 

0.69 

0.60 

0.71 

0.88 

0.76 

0.78 

2.00 

0.72 

0.38 

0.90 

0.02 

0.69 

0.66 

0.73 

0.92 

0.80 

0.92 

0.80 

1.05 

1.46 

0.79 

0.65 

0.65 

0.76 

1.04 

0.72 

1.13 

0.84 

0.93 

1.50 

0.62 

0.73 

0.70 

0.0 

0.75 



0.80 

0.95 

0.78 

1.66 

0.70 

0.67 

0.99 

0.59 

0.76 

0.75 

0.80 

1.02 

0.68 

0.0 

!0.83 

•1.43 

0.81 

2.00 

0.79 

0.85 

1.04 

0.74 

0.80 

0.80 

0.62 

0.63 

0.53 

0.75 

1 .02 

0.88 

0.72 

0.63 

0.69 

0.64 

0.66 

0.67 

0.52 

0.89 

0.97 

0.78 

2.00 

0.84 



0.22 

0.88 

0.47 

0.84 

0.32 

0.24 

0.59 

0.41 

0.40 

0.18 

0.39 

0.56 

0.46 

0.17 

0.59 

0.72 

0.38 

0.59 

0.42 

0.64 

0.07 

0.45 

0.36 

0.46 

0.35 

0.74 

0.52 

0.79 

0.57 

0.30 

0.70 

0.56 

0.29 

0.59 

0.78 

0.71 

0.28 

0.56 

0.53 

0.38 

0.82 

0.44 



0.25 

0.24 

0.34 

0.27 

0.30 

0.27 

0.35 

0.28 

0.29 

0.25 

0.34 

0.36 

0.31 

0.26 

0.32 

0.30 

0.34 

0.34 

0.31 

0.31 

0.20 

0.34 

0.32 

0.35 

0.29 

0.29 

0.34 

0.27 

0.34 

0.30 

0.29 

0.32 

0.28 

0.33 

0.26 

0.30 

0.33 

0.32 

0.34 

0.31 

0.26 

0.33 



0.18 

0.25 

0.36 

0.11 

0.34 

0.34 

0.34 

0.32 

0.27 

0.29 

0.38 

0.28 

0.37 

0.57 

0.30 

0.16 

0.37 

0.10 

0.28 

0.32 

0.17 

0.38 

0.33 

0.38 

0.38 

0.45 

0.54 

0.36 

0.26 

0.28 

0.36 

0.46 

0.34 

0.48 

0.32 

0.45 

0.55 

0.28 

0.28 

0.33 

0.02 

0.32 



0.37 

0.38 

0.30 

0.54 

0.28 

0.25 

0.36 

0.24 

0.31 

0.30 

0.30 

0.43 

0.24 

0.02 

0.35 

0.50 

0.31 

0.60 

0.35 

0.31 

0.46 

0.25 

0.32 

0.31 

0.20 

0.18 

0.12 

0.24 

0.42 

0.35 

0.24 

0.18 

0.26 

0.18 

0.27 

0.17 

0.13 

0.35 

0.41 

0.29 

0.59 

0.34 



0.33 

0.40 

0.47 

0.33 

0.44 

0.42 

0.47 

0.40 

0.38 

0.40 

0.48 

0.45 

0.45 

0.55 

0.43 

0.36 

0.48 

0.34 

0.41 

0.43 

0.35 

0.48 

0.45 

0.49 

0.44 

0.49 

0.56 

0.44 

0.42 

0.41 

0.44 

0.50 

0.42 

0.52 

0.41 

0.49 

0.57 

0.41 

0.43 

0.43 

0.27 

0.44 



0.19 
0.16 
0.02 
0.37 
0.02 
-0.01 
0.08 
-0.00 
0.09 
0.06 
0.00 
0.17 
-0.04 
-0.34 
0.10 
0.30 
0.02 
0.43 
0.10 
0.06 
0.27 
0.00 
0.05 
0.01 
-0.08 
-0.13 
-0.25 
-0.03 
0.18 
0.11 
-0.03 
-0.14 
-0.00 
-0.15 
0.02 
-0.14 
-0.24 
0.10 
0.16 
0.03 
0.47 
0.08 
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Table 27(Cojitinued) 



Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 7 





Item Parameter 


Item 




Factor Loadings 




Item 




Estimates 




Statistics 


Orthogonal 


Oblique 




d 


^1 


^2 


P 


pbls 


I 


II 


I 


II 


43 


-0.82 


0.54 


1.10 


0.:'4 


0.32 


0.16 


0.49 


0.36 


0.30 


44 


0.34 


0.85 


0.96 


0.57 


0.36 


0.36 


0.36 


0.48 


0.07 


45 


0.97 


0.96 


0.73 


^ 0.69 


0.31 


0.41 


0.25 


0.49 


-0.05 


46 


0.81 


0.56 


0.86 


"b.67 


0.29 


0.21 


0.39 


0.36 


0.19 


47 


-1.81 


0.80 


0.95 


0.18 


0.29 


0.35 


0.32 


0.46 


0.04 


48 


-1.98 


1.39 


0.51 


0.18 


„ 0.28 


0.56 


0.09 


0.56 


-0.28 


49 


-0.70 


0.74 


1.13 


0.36 


0.36 


0.30 


0.42 


0.46 


0.15 


'50 


-0.78 


0.88 


0.86 


0.34 


0.34 


0.40 


0.30 


0.50 


-0.01 



Table 28 contains the Intercorrelatlon matrix for the true and estimated 
Item parameters for dataset 7. The correlation between the true and estimated 
d-parameters was 0.988, which Is about the same as was obtained for dataset 
6. The true a-parameters for dimension 1 had a correlation of 0.049 with the 
dimension 2 estimated a-values, and the dimension 2 true a-parameters had a 
correlation of 0.061 with the dimension 1 estimated a-values. 



Table 28 

Intercorrelatlon Matrix for True and Estimated 
Item Parameters for Dataset 7 



True Estimated 
Variable 



ai ao d ai a*; 



True d 1.000 -0.048 0.076 

a, 1.000 -0.985 

32 1.000 



Estimated d 
do 



0.988 


-0.323 


0.364 


0.043 


-0.069 


0.049 


0.075 


0.061 


-0.018 


1.000 


-0.433 


0.468 




1 .000 


-0.836 






1.000 



Table 29 contains the Intercorrelatlon matrix for the true and estimated 
ability parameters for dataset 7. The values In this table follow a pattern 
much like what was found for dataset 6. Each true ability had about equal 
correlations with the two sets of estimates, and both had slightly higher 
correlations with the dimension 2 estimates than with the dimension I 
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estimates. The Inter-dlmenslon ability correlation was 0,334 for the true 
abilities and -0.380 for the estimates. 

Table 29 



Intercorrelatlon Matrix for True and Estimated 
Ability Parameters for Dataset 7 



Variable 




True 




Estimated 










^1 




True 

Estimated 


e' 
'2 


1.000 


0.334 
1.000 


0.381 
0.411 
1.000 


0.430 
0.450 
-0.380 
1.000 



There was a correlation of 0.993 between the proportion-correct 
difficulty Index and the true d-parameter. The correlation was 0.983 for the 
estimated d-parameter. The point blserlal discrimination Index had 
correlations of 0.170 and -0.107 with the true a-parameters and correlations 
of 0.010 and 0.051 with the estimated a-parameters. 



Table 30 shows the Intercorrelatlon matrix for the true and estimated 
Item parameters and the rotated factor loadings for dataset 7. As was the 
case with dataset s 5 and 6, there was a strong relationship betwien the 
estimated a-parameters and both sets of rotated factor loadings, but no 
significant relationship between the true a-parameters and the factor 
loadings. The first four eigenvalues from the principal components analysis 
of dataset 7 were 10.33, 1.31, 1.26, and 1.23. There is a large first factor, 
and the second factor is almost nonexistent. 
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Table 30 

Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 7 



Item Parameters 



Variable 



Factor Loadings 



True 



Estimated 



Orthogonal Oblique 



4 



a 



1 



II 



II 



True 

Estimated 

Orthogonal 
Oblique 



d 

d 

^1 

H 
I 

II 

I 

II 



1.000 -0.048 0.076 0.987 -0.323 0.364 -0.228 0.248 -0.192 0.243 

iL.OOO -0.985 -0.043 -0.069 0.049 0.006 0.040 0.043 0.021 

1.000 0.075 0.061 -0.018 0.003 -0.027 -0.018 -0.017 

; 1.000 -0.433 0.468 -0.322 0.339 -0.279 0.337 

1.000 -0.837 0.924 -0.872 0.885 -0.908 

^ 1.000 -0.832 0.910 -0.695 0.890 

1.000 -0.940 0.961 

1.000 -0.808 
1.000 



-0.980 
0.989 
-0.887 
1 .000 



The correlations of the point biserials with the varimax rotated loadings 
were 0.246 with 0.030. With the oblique rotated loadings, the correlations 
were 0.448 and -0.089. The proportion-correct difficulty index had 
correlations of -0.241 and 0,262 with the varimax rotated loadings, and 
correlations of -0.204 and 0.257 with the oblique rotated loadings. The 
correlation of the proportion-correct difficulty and point biserial 
discrimination indexes was 0.097. 

Dataset 8 . Table 31 shows the item parameter estimates, item statistics, 
and rotated factor loadings for dataset 8. These data were generated using 
test 2 and a group having an inter-dimension ability correlation of 0.00. The 
mean score on test 2 for this group was 24.18, and the standard deviation was 
7.32. The KR-20 reliability was 0,82. The correlation between factors. 



obtained from the oblique rotation, was -0.57, 
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Item 



Table 31 

Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 8 



Item Parameter 
Estimates 



a 



1 



Item 
Statistics 



Factor Loadings 



Orthogonal 



Oblique 



pbls 



II 



II 



1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



-1.39 

2.22 
-0.10 

2.04 
-0.82 
-1.30 

0.51 
-0.43 
-0.48 
-1.72 
-0.54 

0.29 
-0.17 
-1.88 

0.43 

1.34 
-0.54 

0.79 
-0.39 

0.66 
-2.96 
-0.21 
-0.62 
-0.21 
-0.72 



0.59 

0.65 

0.88 

0.54 

0.75 

0.71 

0.55 

0.74 

0.57 

0.59 

0.78 

0.74 

0.83 

1.17 

0.84 

0.29 

0.82 

0.10 

0.62 

0.69 

0.80 

1.09 

0.79 

0.87 

0.72 



0.60 

0.75 

0.64 

1.16 

0.67 

0.62 

1.17 

0.43 

0.67 

0.65 

0.68 

0.87 

0.53 

0.38 

0.68 

1.60 

0.64 

2.00 

0.78 

0.76 

0.92 

0.59 

0.66 

0.78 

0.53 



0.22 

0.88 

0.48 

0.85 

0.33 

0.24 

0.60 

0.40 

0.39 

0.17 

0.38 

0.56 

0.46 

0.17 

0.59 

0.72 

0.38 

0.59 

0.42 

0.64 

O.07 

0.46 

0.37 

0.46 

0.34 



0.21 

0.19 

0.29 

0.23 

0.26 

0.23 

0.30 

0.23 

0.24 

0.20 

0.28 

0.30 

0.26 

0.22 

0.28 

0.26 

0.28 

0.28 

0.27 

0.27 

0.18 

0.30 

0.27 

0.31 

0.23 



0.17 

0.20 

0.38 

0.15 

0.33 

0.30 

0.20 

0.31 

0.22 

0.21 

0.34 

0.29 

0.38 

0.46 

0.36 

0.09 

0.37 

0.08 

0.23 

0.26 

0.20 

0.43 

0.34 

0.30 

0.35 



0.32 
0.31 
0.20 
0.45 
.0.23 
0.23 
0.43 
0.17 
0.29 
0.28 
0.24 
0.34 
0.14 
0.08 
0.23 
0.51 
0.21 
0.53 
0.35 
0.31 
0.38 
0.18 
0.23 
0.35 
0.14 



0.10 
0.14 
0.39 
0.03 
0.32 
0.28 
0.10 
0.32 
0.17 
0.16 
0.32 
0.24 
0.41 
0.51 
0.36 

-0.05 
0.37 

-0.06 
0.16 
0.21 
0.12 
0.45 
0.33 
0.25 
0.37 



-0.30 
-0.27 
-0.06 
-0.46 
-0.12 
-0.13 
-0.41 
-0.06 
-0.24 
-0.2:1 
-0.13 
-0.27 
-0.00 
0.10 
-0.11 
-0.54 
-0.08 
-0.57 
-0.30 
-0.25 
-0.-^5 
-0.03 
-0.12 
-0.27 
-0.01 
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Table 31 (Continued) 



Item Parameter Estimates, Item Statistics, and Factor 

Loadings for Dataset 8 



Item 



26 
27 
28 
29 
30 
31 
32 
'33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 



Item Parameter 
Estimates 



Item 



Factor Loadings 



Statistics Orthogonal 



Oblique 



1.24 
0.10 
1.54 
0.34 
■1.02 
0.98 
0.30 
■0.96 
0.49 
1.47 
1 .00 
-1.68 
0.33 
0.17 
-0.56 
2.66 
-0.28 
-0.81 
0.37 
0.92 
0.90 
-1.80 
-1.81 
-0.69 
-0.77 



^1 



0.96 

1.18 

0.67 

0.76 

0.71 

0.70 

0.97 

0.73 

1 .06 

0.86 

0.70 

2.00 

0.53 

0.63 

0.68 

0.0 

0.77 

0.68 

0.82 

0.79 

0.29 

0.79 

1 .04 

0.77 

0.95 



pbis 



0.56 
0.48 
0.72 
0.95 
0.81 
0.74 
0.54 
0.54 
0.66 
0.56 
0.73 
0.17 
0.99 
0.95 
0.71 
2.00 
0.63 
0.88 
0.89 
0.64 
1.13 
0.84 
0.49 
1.04 
0.68 



0.75 
0.52 
0.80 
0.57 
0.29 
0.71 
0.56 
0.30 
0.60 
0.79 
0.71 
0.27 
0.57 
0.5< 
0.38 
0.82 
0.44 
0.33 
0.58 
0.70 
0.68 
0.17 
0.17 
0.36 
0.34 



0.24 
0.28 
0.22 
0.31 
0.27 
0.25 
0.27 
0.24 
0.30 
0.23 
0.25 
0.28 
0.28 
0.30 
0.26 
0.22 
0.27 
0.28 
0.31 
0.25 
0.24 
0.25 
0.23 
0.32 
0.29 



0.40 
0.48 
0.23 
0.25 
0.29 
0.31 
0.43 
0.36 
0.43 
0.34 
0.33 
0.54 
0.21 
0.20 
0.28 
-0.06 
0.31 
0.20 
0.35 
0.37 
0.06 
0.47 
0.47 
0.27 
0.42 



II 



0.14 
0.08 
0.31 
0.41 
0.30 
0.23 
0.12 
0.15 
0.19 
0.18 
0.23 
0.06 
0.37 
0.42 
0.28 
0.60 
0.25 
0.41 
0.29 
0 J9 
0.^7 
0.28 
0.06 
0.41 
0.19 



0.43 
0.54 
0.17 
0.16 
0.25 
0.30 
0.47 
0.38 
0.45 
0.34 
0.32 
0.62 
0.13 
O.P 
0.25 

-0.25 
0.29 
0.11 
0.32 
0.37 

-0.07 
0.29 
0.54 
0.20 
0.44 



II 



0.02 

0.11 
-0.25 
-0.37 
-0.22 
-0.13 

0.05 
-0.02 
-0.03 
-0.06 
-0.12 

0.16 
-0.34 
-0.40 
-0.20 
-0.71 
-0.16 
rO.38 
-0.19 
-0.06 
-0.51 
-0.19 

0.13 
-0.35 
-0.03 



Table 32 contains the intercorrelation matrix for the true and estimated 
Item parameters for dataset 8. The correlation between the true and estimated 
d-parameters was 0.989. The true and estimated a-values for dimension 1 had a 
correlation of 0.11, while for dimension 2 the correlation was 0.037. 
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Table 32 

\ 

Intercorrelation Matrix for True and Estimated 
Item Parameters for Dataset 8 

True ' Estimated 
Variable , , . — — — 

d a, a, d 



True d 1.000 -0.048 0.076 

^1 
'2 



a, 1.000 -0.985 

ai 1.000 



Estimated d 

*1 
^2 



0,989 


-0.331 


0.370 


0.074 


0.011 


-0.005 


0,104 


-0.017 


0.037 


1,000 


-0.428 


0.464 




1.000 


-0.78A 






1.000 



Table 33 shows the intercorrelation matrix for the true and estimated 
ability parameters for dataset 8. The same pattern is present as was found 
for the other test 2 datasets. Both sets of true abilities had about equal 
correlations with the two sets of estimates. The inter-dimension ability 
correlation was -0,036 for the true values and -0.466 for the estimates. 



Table 33 



Intercorrelation Matrix for True and Estimated 
Ability Parameters for Dataset 8 



Variable 




True 




Estimated 






^2 




^2 


True 

Estimated 


^ 

^2 


1,000 


-0.036 
1,000 


0.288 
0.343 
1.000 


0.309 
0.344 
-0.466 
1,000 



The correlation between the true d-parameter and the proportion-correct 
index was 0.993. The correlation between the proportion-correct index and the 
estimated d-values was 0.986. The correlations of the point biserial index 
and the a-values were 0.140 and -0,083 for the true values, and 0.203 and 
0,084 for the estimates. 

Table 34 shows the intercorrelation matrix for the true and estimated 
item parameters and the two sets of rotated factor loadings obtained for 
dataeet 8. As has been the pattern with the test 2 datasets, there is a 
strong relationship between the estimated a-values and both sets of loadings, 
but no correlation between the true a-values and the factor loadings. The 
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first four eigenvalues from the principal components analysis of dataset 8 
were 8.19, 1.39, 1.30, and 1.29. 

Table 34 

Intercorrelatlon Matrix for True and Estimated Item 
Parameters and Factor Loadings for Dataset 8 



Item Parameters Factor Loadings 

Variable True Estimated Orthogonal Oblique 



True d J 

«1 
a2 

Estimated d 
*2 

Orthogonal I 
II 

Oblique I 
II 



^1 


^2 


d 


*1 


*2 


I 


TI 


I 


II 


•0.048 


0.076 


0.989 


-0.331 


0.370 


-0.308 


0.308 


-0.312 


-0.312 


1.000 


-0.985 


-0.074 


0.011 


-0.005 


-0.035 


0.072 


-0.043 


-0.064 




1.000 


0.104 


-0.017 


0.037 


0.037 


-0.056 


0.042 


0.052i 






1.000 


-0.428 


0.464 


-0.390 


0.380 


-0.392 


-0.388! 








1.000 


-0.784 


0.887 


-0.786 


0.876 


0.823i 










1.000 


-0.818 
1.000 


0.888 
-0.929 
1.000 


-0.844 
0.997 

-0.956 
1.000 


-0.882' 
0.960'i 

-0.995 
0.980 
1.000 



The correlations of the point blserlal Index with the rotated factor 
loadings were 0.243 and 0.074 for the varlmax rotation, and 0.175 and 0.006 
for the oblique rotation. For the proportion-correct difficulty Index the 
correlations were -0.324 and 0.330 with the varlmax rotated loadings, and 
-0.330 and -0.333 with the oblique rotated factor loadings. The correlation 
between the point blserlals and proportion-correct values was 0.073. 

Discussion 

The purpose of this study was to examine the effects of correlated 
abilities on observed test characteristics, and to explore the implications of 
correlated abilities for multidimensional item response theory, or MIRT, 
analysis wh^.n a model is used that does not explicitly account for such a 
correlation. The approach taken was to generate simulation data with known 
true parameters, using varying levels of correlation between abilities, and to 
analyze the data using a number of different test analysis procedures. The 
procedures selected were item analysis, principal component analysis, and MIRT 
analysis. In addition, correlational analyses were performed to explore the 
relationship of obtained statistics and parameter estimates to the true 
parameters, as well as the interrelationships among the item parameter 
estimates and traditional item statistics. All of these analyses were 
performed for two different tests. One test was comprised of two relatively 
Independent dimensions (each item discrirainating on only one of the 
dimensions), while the other test was comprised of two correlated dimensions 
(each item discriminating at least moderately on both dimensions). The 
analyses of these two tests will be discussed separately, r.nd then an attempt 
will be made to integrate the results of the two sets of analyses. 
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Teat 1 Analyses 

In test 1, an attempt was made to use two relatively unldlmenslonal 
subsets of Items. One subset of Items discriminated fairly highly on the 
first dimension, and very poorly on the second. The second subset of Items 
discriminated fairly highly on the second dimension and relatively poorly on 
the first. Thus, the test had two relatively Independent factors. In an 
attempt to evaluate the effects of correlated abilities for such a test, the 
three types of test analysis procedures were applied, and the results 
analyzed. The results for each type of test analysis procedure will now be 
discussed separately. 

Item Analysis Results . The one clear pattern which emerged from the Item 
analyses performed on these data was the decline of the test KR-20 reliability 
with the decline of the correlation between ability dimensions. This trend is 
summarized in Table 35, which shows a drop in reliability from 0.86 to 0.77 
when the inter-dimension ability correlation dropped from 0.70 to 0.00. This 
is an indication that an increased correlation between ability dimensions 
results in more common variance, which in turn yields a higher KR-20. The 
fact that the items were constructed to have a relatively low inter- 
dimensional correlation may have somewhat mitigated this effect, but it did 
not eliminate it. 



Table 35 



Relationship Between Ability Correlation 
and Test Reliability for Test 1 



Dataset 


Ability Correlation 


KR-20 


1 


0.70 


0.86 


2 


0.50 


0.84 


3 


0.35 


0.82 


4 


0.00 


0.77 



Principal Component Analysis Results . One pattern evident in the factor 
analysis results was the decline in factor correlation with the decline in 
ability correlation. This pattern was similar to that found for the KR-20 
analyses, and is also Indicative of the increased multldimensionality of ^he 
test data (decreased size of the common component). The pattern is 
Illustrated in Table 36. 
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Table 36 

Relationship Between Ability Correlation 
and Factor Correlation for Test 1 



Dataset Ability Correlation Factor Cortelation 



1 0.70 

2 0*50 -0.59 

3 0.35 0.52 

4 , 0.00 0.36 



A similar sort of pattern was evident in the eigenvalues resulting from 
the principal components analyses. The first four eigenvalues for each set of 
response data are shown In Table 37. As can be seen, as the ability v , 

correlation decreased , so did the size of the first eigenvalue* At the same 
time 9 the size of the second eigenvalue increased. 
» 

Table 37 



Relationship Between Ability Correlation 
and Eigenvalues for Test 1 



Dataset 


Ability 




Eigenvalues 






Correlation 




E2 


E3 


E4 


1 


0.70 


10.01 


1.50 


1.31- . 


1.27 


2 


0.50 


9.09 


1.79 


1.30 


1.28 


3 


0.35 


7.92 


2.08 


1.43 


1.29 


4 


0.00 


6.32 


2.74 


1.42 


1.32 



Another trend found in the results of these analyses was the tendency 
toward an increase in the correlations between the true item discriminations 
and both the orthogonal and oblique rotated factor loadings as the ability 
correlation decreased. This tendency is shown in Table 38. Bear in mind that 
the correlations shown are not always matched on dimensions. That is 9 in some 
cases the dimension 1 a-value correlation with the factor II loadings is 
shown. 



ERIC 



44 



40 



Table 38 



Relationship Between Ability Correlation 
and Discrimination-Factor Loading Correlation for Test 1 



Dataset 


Ability 


Orthogonal 


Oblique 




Correlation 


I 


II 


I 


II 


1 


0.70 


0.86 


0.86 


0.87 


0.87 


2 


0.50 


0.94 


0.90 


0.93 


0.92 


3 


0.35 


0.96 


0.95 


0.96 


0.96 


4 


0.00 


0.96 


0.95 


0.96 


0.96 



MIRT Analysis Results . As the correlation between ability dimensions 
decreased, there was a slight Increase in the correlations between the true 
and estimated item parameters. That is to say, the estimation program was 
better able to recover the true parameters when the ability dimensions were 
less correlated. This trend is shown in Table 39. Note that the dimensions 
did not always match. That is, some of the correlations reported in Table 39 
for the discrimination values are actually correlations between the true a- 
values on one dimension and the estimated a-values for the other dimension. 



Table 39 



Relationship Between Ability Correlation 
and the Correlation Between True and Estimated 
Item Parameters for Test 1 





Ability 


Item Parameter 




Dataset 












Correlation 


d 


^1 


«2 


1 


0.70 


0.996 


0.73 


0.77 


2 


0,50 


0.998 


0.87 


0.83 


3 


0.35 


0.999 


0.92 


0.94 


4 


0.00 


0.999 


0.92 


0.94 



Another interesting result from the MIRT analyses involved the 
correlation between the discrimination parameters. For test 1 the correlation 
between the true dimension 1 and dimension 2 a-values was -0.987. Table 40 
shows the a-value correlations for the estimated a-values for the four 
datasets for test 1. Note that the correlation is well below (in absolute 
value) the correlation for the true values for dataset 1, but as the ability 
correlation decreases the obtained a-value correlation more nearly appioaches 
the true value. 
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Table 40 

Relationship Between Ability Correlation 
and Inter-Dimension a-Value Correlation 



Dataset Ability Correlation a-Value Correlation 



1 0.70 -0.841 

2 0.50 -0.865 

3 0.35 -0.936 

4 0.00 -0.937 



Table 41 summarizes the correlations between the true and estimated 
ability parameters for test 1. As can be seen, the correlations increase as 
the inter-dimension ability correlation decreases. The estimation program was 
better able to recover the true examinee abilities when the ability dimensions 
were less correlated. This is consistent with the results obtained for the 
item parameters. 

I 

Table 41 



Relationship Between Ability Correlation 
and the Correlations Between the True and Estimated 
Ability Parameters for Test 1 



Dataset 


Ability 


Ability 


Parameter 


Correlation 


^1 


^2 


1 


0.70 


0.70 


0.67 


2 


0.50 


0.74 


0.72 


3 


0.35 


0.78 


0.77 


4 


0.00 


0.81 


0.80 



Table 42 shows the correlations between the two ability dimensions for 
the ability parameter estimates for the four datasets for test 1. Also shown 
are the actual true ability correlations obtained for the four datasets (as 
opposed to the true correlations for the populations from which examinees were 
selected). As can be seen, the sample correlations for the true abilities 
were quite close to the true population values. In every case, however, the 
correlation for the ability parameter estimates is very near 0.0. Regardless 
of the true correlation between ability dimensions, the ability parameter 
estimate dimensions are forced to be uncorrelated. 
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Table 42 



Relationship Be tweerT Ability Correlation 
and Inter-Dimension Ability Estimate 
Correlation for Test 1 



Dataset 


Ability Correlation 
(Population) 


Ability Correlation 
(Sample) 


Ability Estimate 
Correlation 


1 


0.70 


0.68 


-0.14 


2 


'.50 


0.49 


-0.15 


3 


0.35 


0.35 


-0.09 


4 


0.00 


0.01 


-0.05 



Test 2 Analyses 

In test 2 items were selected to have at least moderately high 
discriminations on both dimensions. Thus, the test was constructed to have 
somewhat correlated dimensions. The same analyses performed on test 1 were 
then run on test 2. Again, the results for each type of test analysis 
procedure will be discussed separately* 

Item Analysis Results . The only pattern discernible among the item 
analysis results for the test ?. datasets was a slight decline in KR-20 
reliability with a decrease in the correlation between ability dimensions. 
This trend can be seen in the data shown in Table 43. The trend is less 
dramatic than was the case with the test 1 data, however. In the test 1 
datasets the principal component was due primarily to tha ability dimension 
correlation, while In the test 2 data the principal component was at least 
partially due to the nature of the items. Thus, a decline in ability 
correlation did not have as great an impact on its size. 



Table 43 

Relationship Between Ability Correlation 
and Test Reliability for Test 2 



Dataset Ability Correlation KR-20 



5 V 0'70 0.89 

6 0.50 0.87 

7 0.35 0.86 

8 0.00 0.82 



Principal Component Analysis Results . The pattern of factor correlations 
was rather confusing for the test 2 datasets. These values are shown in Table 
44. 
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Table 44 

Relationship Between Ability Correlation 
and Factor Correlation for Test 2 



Dataset Ability Correlation Factor Correlation 



5 0.70 0.62 

6 0.50 -0.19 

7 0.35 0.23 

8 0.00 -0.57 



As can be seen, there is no systematic relationship between ability 
correlation and factor correlation. To be consistent with the previous 
results, the factor correlation should have declined slightly with the 
decrease in ability correlation. The results for datasets 5 and 8 are 
consistent with this, but the results for datasets 6 and 7 are quite 
Inconsistent with this. As yet, no satisfactory explanation for this 
phenomenon has been determined. 

Table 45 shows the trend in eigenvalues as ability correlation decreased 
for the test 2 data. As can be seen, these results are much more consistent 
with the item analysis results. There was a slight decrease In the size of 
the first eigenvalue with the decrease in ability correlation. The decrease 
Is more marked from dataset 7 to 8 than between the other tests, but so was 
the decline in KR-20. There was a negligible increase in the size of the 
second eigenvalue as the ability correlation decreased. 

Table 45 

Relationship Between Ability Correlation 
and Eigenvalues for Test 2 

Ability Eigenvalues 

Dataset 

Correlation E^ E2 E3 



5 
6 
7 
8 



0.70 
0.50 
0.35 
0.00 



12.32 
11.18 
10.33 
8.19 



1.23 
1.28 
1.31 
1.39 



1.21 
1.25 
1.26 
1.30 



1,18 
1 .22 
1.23 
1 .29 



A pattern found for the test 2 analyses which is in marked contrast to 
the results for test 1 involves the correlations between the true a-values and 
the factor loadings. For test 1 there was a tendency for an increase in 
correlations between a-values and factor loadings as the ability correlation 
decreased. All of the a-value-f actor loading correlations were relatively 
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high, though. For the test 2 data, the true a-value-Zactor loading 
correlations were all around 0.0, regardless of the ability correlation. 

MIRT Analysis Results . As the correlation between ability dimensions 
decreased, the correlation between the true and estimated d-parameters 
decreased slightly, except for dataset 8, for which the correlation was the 
same as for dataset 6. The correlation between the true and estimated 
a-parameters was essentially 0.0 for all four test 2 datasets. 

As the correlation between ability dimensions decreased, the correlations 
between the two a-parameter estimates for the two dimensions diverged from the 
correlation between the true a-parameters. This trend is shown in Table 46. 
The true a-parameter correlation for test 2 was -0.985. 

Table 46 

Relationship Between Ability Correlation 
and Inter-Dimension a-Value Correlation 



Dataset 


Ability Correlation 


a-Value Correlation 


5 


0.70 


-0.837 


6 


0.50 


-0.840 


7 


0.35 


-0.836 


8 


0.00 


-0.784 



Table 47 shows the relationship between true ability correlation and the 
correlation between the true and estimated ability parameters. As can be 
seen, as the true ability correlation decreased, so did the correlations 
between the true and estimated ability parameters. 

Table 47 

Relationship Between Ability Correlation 
and t,he Correlations Betv/een the True and P.stimated 
Ability Parameters for Test 2 



Dataset 


Ability 


Ability Parameter 




Correlation 






5 


0.70 


0.592 


0.507 


6 


0.50 


0.424 


0.465 


7 


0.35 


0.381 


0.450 


8 


0.00 


0.288 


0.344 



Table 48 shows a very interesting pattern involving the Inter-dlmenslon 
ability estimate correlations for test 2. As can be seen, the sample crue 
ability dimension correlations are quite close to the target population 
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values. For the ability estimates, however, the correlation differs 
substantially from the true ability correlation. In every case the 
correlation is negative, and it becomes more negative as the true value 
approached 0«0. 

Table 48 



Relationship Between Ability Correlation 
and Inter-Dlraension Ability Estimate 
Correlation for Test 2 



Dataset 


Ability Correlation 
(Population) 


Ability Correlation 
(Sample) 


Ability Estimate 
Correlation 


5 


0.70 


0.69 , 


-0.20 


6 


0.50 


0.49 


-0.38 


7 


0.35 


0.33 


-0.38 


8 


0.00 


-0.04 


-0.47 



Overall Results 

It is quite clear chat it is not enough to talk about the ^dimensionality 
of a test*, or about whether the 'dimensions of a test' are correlated. There 
are two distinct concepts involved, and they play quite different roles in 
determining the latent structure of response data. The first concept is 
latent item structure, and the second is latent ability structure. 

The latent structure of a test item refers to the number and 
interrelationships of the dimensions required for performance on the item. In 
this research, two types of latent item structure were employed. For test 1, 
each item required basically only one dimension. The first half of the items 
required the first dimension, while the second half required the second 
dimension. Thus, there were two dimensions underlying the test, each of which 
operated relatively independently of the other. 

For test 2, each item required two dimensions. For some items the first 
dimension was more dominant than the second, while for the remaining items the 
second dimension was dominant. Since all Items required both dimensions, the 
two dimensions did not operate as independently as for test !• 

The latent ability structure of an examinee refers to the number and 
interrelationships of the dimensions underlying the examinee's responses. In 
this study the latent ability space was always two-dimensional, but the 
correlation of the two examinee latent ability dimensions varied. 

It is the interaction of these two concepts which determines the latent 
structure of response data. When the item dimensions operate relatively 
independently, the dimensionality of the response data depends to a great 
extent on the latent ability structure of the examinees. Correlated abilities 
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tend to yield response data with a single dominant component or, viewed 
differently, response data with correlated Latent dimensions. Uncorrelated 
abilities tend to yield response data with relatively uncorrelated latent 
dimensions. 

When the latent item dimensions do not operate independently, the effect 
of the latent ability structure is less pronounced. The effect of the 
correlation between latent ability dimensions is the same, but less extreme. 

The effect of the interaction of latent ability and item structures has 
serious implications for the analysis of test data and, perhaps more 
'importantly, for test development. Clearly it is not sufficient to consider 
only item characteristics when constructing or analyzing a test. It is not 
appropriate to assume that the latent ability structure is determined by item 
characteristics. It is necessary to consider how the two interact to produce 
a latent structure for test data. 

The results of this study also have important implications for the 
application of MIRT methodology. The presence of correlated abilities 
certainly had pronounced effects on the results obtained from the application 
of the MIRT mpdel selected for this study. The most important finding of this 
study regarding the use of MIRT methodology involves the inability of the MIRT 
model estimation program to recover the true dimensions when the dimensions 
were correlated. 

When latent item dimensions are independent, the procedure works fairly 
well, even when the latent ability dimensions are correlated. However, an 
increased correlation between latent ability dimensions does lower the 
correlations between the true and estimated abilities. This does not 
necessarily mean thc.t the estimation process breaks down. It simply means 
that the nature of the ability dimensions recovered by estimation is somewhat 
different than for the true dimensions. It is entirely possible that the 
estimated dimensions are in some sense a rotation of the true dimensions due 
to the fact that the estimation procedure and/or model does not explicitly 
account for inter-dimensional correlations. 

When latent item dimensions are not independent, the recovered dimensions 
are different from the true dimensions regardless of whether or not the latent 
ability dimensions are correlated. Again, eome type of rotation of the latent 
ability structure might be involved. Under the circumstances, if MIRT 
methodology is to be viable, research on this question must be conducted. If 
a rotation is involved, it is imperative that its nature be discovered. 
Moreover, if MIRT parameters are to be invariant and interpretable , it seeras 
likely that it will be necessary to develop something analag.iis to factor 
rotations in factor analysis. 

Summary and Conclusions 

A study was conducted to assess the effects of correlated abilities on 
test characteristics, and to explore the effects of correlated abilities on 
the use of a multidimensional item response theory model which does not 
explicitly account for such a correlation. Two tests were constructed. One 
test had two relatively unidimensional subsets of items, while the other had 
items that were all two-dimensional. For each test response data were 
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generated according to a multidimensional two-parameter logistic model using 
four groups of examinees. The groups of examinees differed In the degree of 
Inter-dlmenslon ability correlation. 

To evaluate the effects of correlated abilities on test characteristics, 
the simulated response data were analyzed using item analysis and principal 
component analysis techniques. To assess the effects of correlated abllitleB 
on the use of the multidimensional model, the parameters of the model were 
estimated, and the estimates were compared to the true parameters. 

The results of this study indicated that the presence of correlated 
abilities has important implications for the characteristics of test data, and 
for the application of multidimensional item response theory models. It was 
concluded that it is necessary to consider latent item structure as well as 
latent ability structure in test construction and analysis. It was also 
concluded that use of multidimensional item response theory models that do not 
explicitly account for correlated abilities may not yield accurate information 
about the nature of underlying dimensions. It was suggested that research 
should be conducted to determine the relationship between the observed and . 
true correlation between abilities, and to perhaps develop an item response 
theory analogue to factor rotation. 
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